Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Analyzing image-text relations for semantic media adaptation and personalization

Hughes, Mark, Salway, Andrew, Jones, Gareth J.F. orcid logoORCID: 0000-0003-2923-8365 and O'Connor, Noel E. orcid logoORCID: 0000-0002-4033-9135 (2007) Analyzing image-text relations for semantic media adaptation and personalization. In: SMAP 2007 - Second International Workshop on Semantic Media Adaptation and Personalization, 17-18 December 2007, London, UK.

Abstract
Progress in semantic media adaptation and personalisation requires that we know more about how different media types, such as texts and images, work together in multimedia communication. To this end, we present our ongoing investigation into image-text relations. Our idea is that the ways in which the meanings of images and texts relate in multimodal documents, such as web pages, can be classified on the basis of low-level media features and that this classification should be an early processing step in systems targeting semantic multimedia analysis. In this paper we present the first empirical evidence that humans can predict something about the main theme of a text from an accompanying image, and that this prediction can be emulated by a machine via analysis of low- level image features. We close by discussing how these findings could impact on applications for news adaptation and personalisation, and how they may generalise to other kinds of multimodal documents and to applications for semantic media retrieval, browsing, adaptation and creation.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Workshop
Refereed:Yes
Uncontrolled Keywords:semantic media adaptation and personalisation
Subjects:Computer Science > Information retrieval
Computer Science > Image processing
DCU Faculties and Centres:Research Initiatives and Centres > Centre for Digital Video Processing (CDVP)
Publisher:Institute of Electrical and Electronics Engineers
Official URL:http://dx.doi.org/10.1109/SMAP.2007.4414407
Copyright Information:Copyright © 2007 IEEE. Reprinted from Second International Workshop on Semantic Media Adaptation and Personalization. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to pubs-permissions@ieee.org. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.
Funders:European Commission FP6 045335
ID Code:439
Deposited On:20 May 2008 by DORAS Administrator . Last Modified 25 Oct 2018 12:39
Documents

Full text available as:

[thumbnail of ieee_smap_2007.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
719kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record