Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Rethinking the test collection methodology for personal self-tracking data

Hopfgartner, Frank orcid logoORCID: 0000-0003-0380-6088, Gurrin, Cathal orcid logoORCID: 0000-0003-2903-3968 and Joho, Hideo (2019) Rethinking the test collection methodology for personal self-tracking data. In: 26th International Conference on Multimedia Modeling (MMM2020),, 5-8 Jan 2020, Daejeon, Korea (Republic of). ISBN 978-3-030-37733-5

Abstract
While vast volumes of personal data are being gathered daily by individuals, the MMM community has not really been tackling the challenge of developing novel retrieval algorithms for this data, due to the challenges of getting access to the data in the first place. While initial efforts have taken place on a small scale, it is our conjecture that a new evaluation paradigm is required in order to make progress in analysing, modeling and retrieving from personal data archives. In this position paper, we propose a new model of Evaluation-as-a-Service that re-imagines the test collection methodology for personal multimedia data in order to address the many challenges of releasing test collections of personal multimedia data.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Uncontrolled Keywords:lifelogging; evaluation; self-tracking.
Subjects:Computer Science > Information retrieval
Computer Science > Lifelog
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Research Initiatives and Centres > ADAPT
Published in: 26th International Conference, MMM 2020, Proceedings. Lecture Notes in Computer Science 11962. Springer. ISBN 978-3-030-37733-5
Publisher:Springer
Official URL:http://dx.doi.org/10.1007/978-3-030-37734-2_38
Copyright Information:© 2019 Springer
ID Code:24665
Deposited On:22 Jun 2020 12:52 by Cathal Gurrin . Last Modified 15 Dec 2021 15:45
Documents

Full text available as:

[thumbnail of MMM2020_Personal_Datasets.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
150kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record