Pasi, Gabriella ORCID: 0000-0002-6080-8170, Jones, Gareth J.F. ORCID: 0000-0003-2923-8365, Marrara, Stefania, Sanvitto, Camilla, Ganguly, Debasis ORCID: 0000-0003-0050-7138 and Sen, Procheta (2017) Overview of the CLEF 2017 personalised information retrieval pilot lab (PIR-CLEF 2017). In: 8th International Conference of the CLEF Association (CLEF 2017), 11-14 Sept 2017. ISBN 978-3-319-65812-4
Abstract
The Personalised Information Retrieval (PIR-CLEF) Lab
workshop at CLEF 2017 is designed to provide a forum for the exploration of methodologies for the repeatable evaluation of personalised
information retrieval (PIR). The PIR-CLEF 2017 Lab provides a preliminary pilot edition of a Lab task dedicated to personalised search, while
the workshop at the conference is intended to provide a forum for the
discussion of strategies for the evaluation of PIR and extension of the
pilot Lab task. The PIR-CLEF 2017 Pilot Task is the first evaluation
benchmark based on the Cranfield paradigm, with the potential benefits
of producing evaluation results that are easily reproducible. The task is
based on search sessions over a subset of the ClueWeb12 collection, undertaken by 10 users by using a clearly defined and novel methodology.
The collection provides data gathered by the activities undertaken during the search sessions by each participant, including details of relevant
documents as marked by the searchers. The PIR-CLEF 2017 workshop
is intended to review the design and construction of this Pilot collection and to consider the topic of reproducible evaluation of PIR more
generally with the aim of launching a more formal PIR Lab at CLEF
2018
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Conference |
Refereed: | Yes |
Subjects: | Computer Science > Information retrieval |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing Research Initiatives and Centres > ADAPT |
Published in: | Jones, Gareth J. F., Lawless, Séamus, Gonzalo, Julio and Kelly, Liadh, (eds.) 8th International Conference of the CLEF Association, Proceedings. Lecture Notes in Computer Science 10456. Springer. ISBN 978-3-319-65812-4 |
Publisher: | Springer |
Official URL: | http://dx.doi.org/10.1007%2F978-3-319-65813-1_29 |
Copyright Information: | © 2017 Springer |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
ID Code: | 23383 |
Deposited On: | 30 May 2019 15:30 by Thomas Murtagh . Last Modified 05 May 2022 08:39 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
155kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record