Mohedano Robles, Eva (2017) Deep image representations for instance search. PhD thesis, Dublin City University.
Abstract
We address the problem of visual instance search, which consists to retrieve all
the images within an dataset that contain a particular visual example provided to
the system. The traditional approach of processing the image content for this task
relied on extracting local low-level information within images that was “manually
engineered” to be invariant to di↵erent image conditions. One of the most popular
approaches uses the Bag of Visual Words (BoW) model on the local features to
aggregate the local information into a single representation. Usually, a final reranking stage is included in the pipeline to refine the search results. Since the
emergence of deep learning as the dominant technique in computer vision in 2012,
much research attention has been focused on deriving image representations from
Convolutional Neural Networks (CNN) models for the task of instance search as a
“data driven” approach to designing image representations. However, one of the main
challenges in the instance search task is the lack of annotated datasets to fit CNN
models parameters.
This work explores the capabilities of descriptors derived from pre-trained CNN
models for image classification to address the task of instance retrieval. First, we
conduct an investigation of the traditional bag of visual words encoding on local
CNN features to produce a scalable image retrieval framework that generalizes well
across di↵erent retrieval domains. Second, we propose to improve the capacity of the
obtained representations by exploring an unsupervised fine-tuning strategy that allow
us to obtain better performing representations at the price of losing the generalization
of the representations. Finally, we propose using visual attention models to weight
the contribution of the relevant parts of an image to obtain a very powerful image
representation for instance retrieval without requiring the construction of a large
and suitable training dataset for fine-tuning CNN architectures.
Metadata
Item Type: | Thesis (PhD) |
---|---|
Date of Award: | November 2017 |
Refereed: | No |
Supervisor(s): | McGuinness, Kevin and O'Connor, Noel E. |
Subjects: | Computer Science > Information retrieval Computer Science > Image processing |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Electronic Engineering Research Initiatives and Centres > INSIGHT Centre for Data Analytics |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 3.0 License. View License |
Funders: | Science Foundation Ireland |
ID Code: | 22178 |
Deposited On: | 05 Apr 2018 11:31 by Noel Edward O'connor . Last Modified 28 Jul 2021 16:38 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
33MB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record