Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Towards evaluation of personalized and collaborative information retrieval

Ganguly, Debasis orcid logoORCID: 0000-0003-0050-7138, Leveling, Johannes orcid logoORCID: 0000-0003-0603-4191, Li, Wei B. orcid logoORCID: 0000-0001-7347-3501 and Jones, Gareth J.F. orcid logoORCID: 0000-0003-2923-8365 (2011) Towards evaluation of personalized and collaborative information retrieval. In: The First Workshop on Personalised Multilingual Hypertext Retrieval (PMHR 2011), 6th June 2011, Eindhoven, The Netherlands.

Abstract
We propose to extend standard information retrieval (IR) ad-hoc test collection design to facilitate research on personalized and collaborative IR by gathering additional meta-information during the topic (query) development process. We propose a controlled query generation process with activity logging for each topic developer. The standard ad-hoc collection will thus be accompanied by a new set of thematically related topics and the associated log information, and has the potential to simulate a real-world search scenario to encourage retrieval systems to mine user information from the logs to improve IR effectiveness. The proposed methodology described in this paper will be applied in a pilot task which is scheduled to run in the FIRE 2011 evaluation campaign. The task aims at investigating the research question of whether personalized and collaborative IR retrieval experiments and evaluation can be pursued by enriching a standard ad-hoc collection with such meta-information.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Workshop
Refereed:Yes
Uncontrolled Keywords:query development; relevance
Subjects:Computer Science > Information retrieval
DCU Faculties and Centres:Research Initiatives and Centres > Centre for Next Generation Localisation (CNGL)
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
ID Code:16390
Deposited On:29 Jun 2011 13:48 by Shane Harper . Last Modified 07 Oct 2021 12:38
Documents

Full text available as:

[thumbnail of Towards_Evaluation_of_Personalized_and_Collaborative_Information_Retrieval.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
234kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record