Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

VAISL: Visual-aware identification of semantic locations in lifelog

Tran, Ly-Duyen, Nie, Dongyun, Zhou, Liting, Nguyen, Binh and Gurrin, Cathal orcid logoORCID: 0000-0003-4395-7702 (2023) VAISL: Visual-aware identification of semantic locations in lifelog. In: International Conference on Multimedia Modeling. ISBN 978-3-031-27817-4

Abstract
Organising and preprocessing are crucial steps in order to perform analysis on lifelogs. This paper presents a method for preprocessing, enriching, and segmenting lifelogs based on GPS trajectories and images captured from wearable cameras. The proposed method consists of four components: data cleaning, stop/trip point classification, post-processing, and event characterisation. The novelty of this paper lies in the incorporation of a visual module (using a pretrained CLIP model) to improve outlier detection, correct classification errors, and identify each event’s movement mode or location name. This visual component is capable of addressing imprecise boundaries in GPS trajectories and the partition of clusters due to data drift. The results are encouraging, which further emphasises the importance of visual analytics for organising lifelog data.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:Lifelogging; GPS trajectories; Embedding models
Subjects:Computer Science > Information retrieval
Computer Science > Information technology
Computer Science > Information storage and retrieval systems
Computer Science > Lifelog
DCU Faculties and Centres:UNSPECIFIED
Published in: MultiMedia Modeling. MMM 2023. 13834. Springer. ISBN 978-3-031-27817-4
Publisher:Springer
Official URL:https://link.springer.com/chapter/10.1007/978-3-03...
Copyright Information:Authors
Funders:SFI Centre for Research Training in Digitally Enhanced Reality
ID Code:29961
Deposited On:29 Apr 2024 14:10 by Ly Duyen Tran . Last Modified 29 Apr 2024 14:10
Documents

Full text available as:

[thumbnail of VAISL.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Creative Commons: Attribution-Noncommercial-No Derivative Works 4.0
1MB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record