Pasi, Gabriella 
ORCID: 0000-0002-6080-8170, Jones, Gareth J.F. ORCID: 0000-0003-2923-8365, Curtis, Keith, Marrara, Stefania, Sanvitto, Camilla, Ganguly, Debasis ORCID: 0000-0003-0050-7138 and Sen, Procheta
(2018)
Overview of the CLEF 2018 personalised
information retrieval lab (PIR-CLEF 2018).
In: CLEF 2018 - Conference and Labs of the Evaluation Forum, 10-14 Sept 2018, Avignon, France.
Abstract
At CLEF 2018, the Personalised Information Retrieval Lab
(PIR-CLEF 2018) has been conceived to provide an initiative aimed at
both providing and critically analysing a new approach to the evaluation
of personalization in Information Retrieval (PIR). PIR-CLEF 2018 is the
first edition of this Lab after the successful Pilot lab organised at CLEF
2017. PIR CLEF 2018 has provided registered participants with the data
sets originally developed for the PIR-CLEF 2017 Pilot task; the data collected are related to real search sessions over a subset of the ClueWeb12
collection, undertaken by 10 users by using a novel methodology. The
data were gathered during the search sessions undertaken by 10 volunteer searchers. Activities during these search sessions included relevance
assessment of a retrieved documents by the searchers. 16 groups registered to participate at PIR-CLEF 2018 and were provided with the data
set to allow them to work on PIR related tasks and to provide feedback
about our proposed PIR evaluation methodology with the aim to create
an effective evaluation task.
Metadata
| Item Type: | Conference or Workshop Item (Paper) |
|---|---|
| Event Type: | Conference |
| Refereed: | Yes |
| Subjects: | Computer Science > Information retrieval |
| DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing Research Initiatives and Centres > ADAPT |
| Published in: | CLEF 2018 - Conference and Labs of the Evaluation Forum. . CEUR-WS. |
| Publisher: | CEUR-WS |
| Official URL: | http://ceur-ws.org/Vol-2125/invited_paper_12.pdf |
| Copyright Information: | © 2018 The Authors |
| Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
| ID Code: | 23394 |
| Deposited On: | 04 Jun 2019 16:12 by Thomas Murtagh . Last Modified 31 Jul 2019 08:50 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
320kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record
Altmetric
Altmetric