Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

A proposal for the evaluation of adaptive information retrieval systems using simulated interaction

Mulwa, Catherine, Li, Wei B., Lawless, Séamus and Jones, Gareth J.F. orcid logoORCID: 0000-0003-2923-8365 (2010) A proposal for the evaluation of adaptive information retrieval systems using simulated interaction. In: SimInt 2010 - Simulation of Interaction. SIGIR Workshop on the Automated Evaluation of Interactive Information Retrieval, 23 July 2010, Geneva, Switzerland.

Abstract
The Centre for Next Generation Localisation (CNGL) is involved in building interactive adaptive systems which combine Information Retrieval (IR), Adaptive Hypermedia (AH) and adaptive web techniques and technologies. The complex functionality of these systems coupled with the variety of potential users means that the experiments necessary to evaluate such systems are difficult to plan, implement and execute. This evaluation requires both component-level scientific evaluation and user-based evaluation. Automated replication of experiments and simulation of user interaction would be hugely beneficial in the evaluation of adaptive information retrieval systems (AIRS). This paper proposes a methodology for the evaluation of AIRS which leverages simulated interaction. The hybrid approach detailed combines: (i) user-centred methods for simulating interaction and personalisation; (ii) evaluation metrics that combine Human Computer Interaction (HCI), AH and IR techniques; and (iii) the use of qualitative and quantitative evaluations. The benefits and limitations of evaluations based on user simulations are also discussed.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Workshop
Refereed:Yes
Subjects:Computer Science > Information retrieval
DCU Faculties and Centres:Research Initiatives and Centres > Centre for Next Generation Localisation (CNGL)
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Official URL:http://www.dcs.gla.ac.uk/access/simint/
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Science Foundation Ireland
ID Code:15837
Deposited On:24 Nov 2010 12:55 by Shane Harper . Last Modified 25 Oct 2018 10:40
Documents

Full text available as:

[thumbnail of A_Proposal_for_the_Evaluation_of_Adaptive_Information_Retrieval_Systems_using_Simulated_Interaction.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
103kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record