Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

The colour of life: interacting with SenseCam images on large multi-touch display walls

Kelly, Philip, Kumar, Anil, Doherty, Aiden R. orcid logoORCID: 0000-0003-1840-0451, Lee, Hyowon orcid logoORCID: 0000-0003-4395-7702, Smeaton, Alan F. orcid logoORCID: 0000-0003-1028-8389, Gurrin, Cathal orcid logoORCID: 0000-0003-2903-3968 and O'Connor, Noel E. orcid logoORCID: 0000-0002-4033-9135 (2010) The colour of life: interacting with SenseCam images on large multi-touch display walls. In: SenseCam 2010 - second annual SenseCam symposium, 16-17 September 2010, Dublin, Ireland. ISBN 1872-327-915

Abstract
A SenseCam can provide a detailed visual archive of a person’s life, activities and experiences. However, as the number of images captured per year can extend beyond one million, gaining an insight into an individual’s lifestyle in a fast, effective and intuitive manner is a challenging prospect. In this work, we develop an interactive image browsing tool, which incorporates visualisation techniques that can capture not only a snapshot of an individual’s lifestyle over long periods of time, but also how that lifestyle varies with changing days, weeks, or years. The image retrieval tool incorporates the Colour of Life algorithms [1], which can represent an overview of millions of images with a single visualisation. The Colour of Life algorithms focus on the relationship between lifestyle and colour, by capturing the colours to which we are exposed in our lives (and therefore captured by SenseCam images), collating similar colours for specific time periods and depicting how those colours change over time with a flowing time-line – see Figure 1 which depicts the life of a SenseCam user over the period of 8 days. In this figure, time is orientated along the horizontal axis and larger vertical peaks indicate higher user activity for a given period of time. In Figure 1, the normal working week consists of the rhythmical blue, pink (work) and yellow (home) peaks and troughs for each day (with less activity at the start and end of the days), whereas time outdoors increases at the weekend, especially during the night (and hence the darker colours on the left hand side of the figure). The Colour of Life visualisation, while providing information on changes in lifestyle, does not provide sufficient context to understand the exact activities of a user for a given time period. For example, on the left of Figure 1 there is a peak of purple, that does not occur anywhere else during the 8 days of activities images – where was the user at this point in time and what was he doing? In this work, we build an interactive image browsing tool based around the Colour of Life visualisation. We exploit the use of high resolution multi-touch display walls, where we extend the Colour of Life algorithms to produce an intuitive visualisation, which incorporates image mosaicing (see Figure 2). Through this we incorporate coarse lifestyle data with more fine detailed contextual information on human activities into one interactive visualisation tool. As an additional feature, we have investigated the use of image classification within the framework of the Colour of Life. One such example is the categorisation of images as being as social (i.e. interacting with other people) or non-social. Using such a classification, we can depict a person’s social lifestyle, and how that varies over time.
Metadata
Item Type:Conference or Workshop Item (Speech)
Event Type:Workshop
Refereed:No
Subjects:Computer Science > Lifelog
Computer Science > Interactive computer systems
Computer Science > Visualization
Computer Science > Multimedia systems
Computer Science > Image processing
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Electronic Engineering
Research Initiatives and Centres > Centre for Digital Video Processing (CDVP)
Research Initiatives and Centres > CLARITY: The Centre for Sensor Web Technologies
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Publisher:Dublin City University
Official URL:http://www.clarity-centre.org/sensecam2010/
Copyright Information:Copyright 2010 the authors
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Science Foundation Ireland
ID Code:15707
Deposited On:22 Sep 2010 08:57 by Dr Aiden Doherty . Last Modified 04 Oct 2018 11:46
Documents

Full text available as:

[thumbnail of presentation slides]
Preview
PDF (presentation slides) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
1MB
[thumbnail of abstract]
Preview
PDF (abstract) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
181kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record