Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Training-free indexing refinement for visual media via multi-semantics

Wang, Peng, Sun, Lifeng, Shiqiang, Yang and Smeaton, Alan F. orcid logoORCID: 0000-0003-1028-8389 (2016) Training-free indexing refinement for visual media via multi-semantics. Neurocomputing, 236 . pp. 39-47. ISSN 0925-2312

Abstract
Indexing of visual media based on content analysis has now moved beyond using individual concept detectors and there is now a focus on combining concepts by post-processing the outputs of individual concept detection. Due to the limitations and availability of training corpora which are usually sparsely and imprecisely labeled with concept groundtruth, training-based refinement methods for semantic indexing of visual media suffer in correctly capturing relationships between concepts, including co-occurrence and ontological relationships. In contrast to training-dependent methods which dominate this field, this paper presents a training-free refinement (TFR) algorithm for enhancing semantic indexing of visual media based purely on concept detection results, making the refinement of initial concept detections based on semantic enhancement, practical and flexible. This is achieved using what can be called multi-semantics, factoring in semantics from multiple sources. In the case of this paper, global and temporal neighbourhood information inferred from the original concept detections in terms of weighted non-negative matrix factorization and neighbourhood-based graph propagation are both used in the refinement of semantics. Furthermore, any available ontological concept relationships among concepts can also be integrated into this model as an additional source of external a priori knowledge. Extended experiments on two heterogeneous datasets, images from wearable cameras and videos from TRECVid, demonstrate the efficacy of the proposed TFR solution.
Metadata
Item Type:Article (Published)
Refereed:Yes
Uncontrolled Keywords:Semantic indexing; Refinement; Concept detection enhancement; Context fusion; Factorization; Propagation
Subjects:Computer Science > Lifelog
Computer Science > Digital video
DCU Faculties and Centres:Research Initiatives and Centres > INSIGHT Centre for Data Analytics
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Publisher:Elsevier
Official URL:http://dx.doi.org/10.1016/j.neucom.2016.08.107
Copyright Information:© Elsevier 2016
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Science Foundation Ireland SFI/12/RC/2289, 973 Program under Grant No. 2011CB302206, National Natural Science Foundation of China under Grant No. 61272231, 61472204, 61502264
ID Code:21507
Deposited On:08 Dec 2016 15:24 by Alan Smeaton . Last Modified 31 Oct 2018 11:36
Documents

Full text available as:

[thumbnail of NEUCOM-D-16-00855R1.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
4MB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record