Doherty, Aiden R. ORCID: 0000-0003-4395-7702, Ó Conaire, Ciarán, Blighe, Michael, Smeaton, Alan F. ORCID: 0000-0003-1028-8389 and O'Connor, Noel E. ORCID: 0000-0002-4033-9135 (2008) Combining image descriptors to effectively retrieve events from visual lifelogs. In: MIR 2008 - ACM International Conference on Multimedia Information Retrieval, 30-31 October, Vancouver, Canada.
Abstract
The SenseCam is a wearable camera that passively captures approximately 3,000 images per day, which equates to almost one million images per year. It is used to create a personal visual recording of the wearer's life and generates information which can be helpful as a human memory aid. For such a large amount of visual information to be of any use, it is accepted that it should be structured into "events", of which there are about 8,000 in a wearer's average year. In automatically segmenting SenseCam images into events, it will then be useful for users to locate other events similar to a given event e.g. "what other times was I walking in the park?", "show me other events when I was in a restaurant". On two datasets of 240k and 1.8M images containing topics with a variety of information needs, we evaluate the fusion of MPEG-7, SIFT, and SURF content-based retrieval techniques to address the event search issue. We have found that our proposed fusion approach of MPEG-7 and SURF offers an improvement on using either of those sources or SIFT individually, and we have also shown how a lifelog event is modeled has a large effect on the retrieval performance.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Conference |
Refereed: | Yes |
Subjects: | Computer Science > Lifelog Computer Science > Multimedia systems Computer Science > Information retrieval Computer Science > Image processing |
DCU Faculties and Centres: | Research Initiatives and Centres > CLARITY: The Centre for Sensor Web Technologies DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing |
Publisher: | Association for Computing Machinery |
Official URL: | http://press.liacs.nl/mir2008/ |
Copyright Information: | Copyright 2008 ACM |
Funders: | Science Foundation Ireland, Irish Research Council for Science Engineering and Technology, Microsoft Research |
ID Code: | 2081 |
Deposited On: | 07 Nov 2008 12:35 by Dr Aiden Doherty . Last Modified 04 Oct 2018 11:36 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
520kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record