Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Task 2: ShARe/CLEF eHealth evaluation lab 2014

Mowery, Danielle L., Velupillai, Sumithra, South, Brett R., Christensen, Lee, Martinez, David, Kelly, Liadh orcid logoORCID: 0000-0003-1131-5238, Goeuriot, Lorraine orcid logoORCID: 0000-0001-7491-1980, Elhadad, Noemie, Pradhan, Sameer, Savova, Guergana and Chapman, Wendy (2014) Task 2: ShARe/CLEF eHealth evaluation lab 2014. CLEF 2014 Online Working Notes, 1180 . pp. 31-42. ISSN 1613-0073

Abstract
This paper reports on Task 2 of the 2014 ShARe/CLEF eHealth evaluation lab which extended Task 1 of the 2013 ShARe/CLEF eHealth evaluation lab by focusing on template lling of disorder attributes. The task was comprised of two subtasks: attribute normalization (task 2a) and cue identication (task 2b).We instructed participants to develop a system which either kept or updated a default attribute value for each task. Participant systems were evaluated against a blind reference standard of 133 discharge summaries using Accuracy (task 2a) and F-score (task 2b). In total, ten teams participated in task 2a, and three teams in task 2b. For task 2a and 2b, the HITACHI team systems (run 2) had the highest performances, with an overall average average accuracy of 0.868 and F1-score (strict) of 0.676, respectively.
Metadata
Item Type:Article (Published)
Refereed:Yes
Uncontrolled Keywords:Natural Language Processing; Template Filling; Information Extraction; Clinical Text
Subjects:Computer Science > Information retrieval
DCU Faculties and Centres:Research Initiatives and Centres > Centre for Next Generation Localisation (CNGL)
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Publisher:CEUR-WS
Official URL:http://ceur-ws.org/Vol-1180/
Copyright Information:© 2014 The Authors
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
ID Code:20112
Deposited On:29 Sep 2014 12:37 by Liadh Kelly . Last Modified 25 Oct 2018 14:33
Documents

Full text available as:

[thumbnail of invited_paper_10.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
244kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record