Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Exploiting visual salience for the generation of referring expressions

Kelleher, John D. and van Genabith, Josef (2004) Exploiting visual salience for the generation of referring expressions. In: the 17th International Florida Artificial Intelligence Research Society Conference (FLAIRS’04), 17 - 19 May 2004, Miami Beach, Florida.

Abstract
In this paper we present a novel approach to generating referring expressions (GRE) that is tailored to a model of the visual context the user is attending to. The approach integrates a new computational model of visual salience in simulated 3-D environments with Dale and Reiter’s (1995) Incremental Algorithm. The advantage of our GRE framework are: (1) the context set used by the GRE algorithm is dynamically computed by the visual saliency algorithm as a user navigates through a simulation; (2) the integration of visual salience into the generation process means that in some instances underspecified but sufficiently detailed descriptions of the target object are generated that are shorter than those generated by GRE algorithms which focus purely on adjectival and type attributes; (3) the integration of visual saliency into the generation process means that our GRE algorithm will in some instances succeed in generating a description of the target object in situations where GRE algorithms which focus purely on adjectival and type attributes fail.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:generating referring expressions; GRE algorithms
Subjects:Computer Science > Machine translating
DCU Faculties and Centres:Research Initiatives and Centres > National Centre for Language Technology (NCLT)
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Publisher:American Association for Artificial intelligence
Official URL:http://www.aaai.org/Library/FLAIRS/flairs04content...
Copyright Information:© 2004 AAAI
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
ID Code:16166
Deposited On:20 Jul 2011 13:59 by Shane Harper . Last Modified 19 Jul 2018 14:53
Documents

Full text available as:

[thumbnail of Exploiting_Visual_Salience_for_the_Generation_of_Referring_Expressions.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
609kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record