Mowery, Danielle L., Velupillai, Sumithra, South, Brett R., Christensen, Lee, Martinez, David, Kelly, Liadh ORCID: 0000-0003-1131-5238, Goeuriot, Lorraine ORCID: 0000-0001-7491-1980, Elhadad, Noemie, Pradhan, Sameer, Savova, Guergana and Chapman, Wendy (2014) Task 2: ShARe/CLEF eHealth evaluation lab 2014. CLEF 2014 Online Working Notes, 1180 . pp. 31-42. ISSN 1613-0073
Abstract
This paper reports on Task 2 of the 2014 ShARe/CLEF
eHealth evaluation lab which extended Task 1 of the 2013 ShARe/CLEF eHealth evaluation lab by focusing on template lling of disorder attributes. The task was comprised of two subtasks: attribute normalization (task 2a) and cue identication (task 2b).We instructed participants
to develop a system which either kept or updated a default attribute value for each task. Participant systems were evaluated against a blind reference standard of 133 discharge summaries using Accuracy (task 2a)
and F-score (task 2b). In total, ten teams participated in task 2a, and three teams in task 2b. For task 2a and 2b, the HITACHI team systems (run 2) had the highest performances, with an overall average average accuracy of 0.868 and F1-score (strict) of 0.676, respectively.
Metadata
Item Type: | Article (Published) |
---|---|
Refereed: | Yes |
Uncontrolled Keywords: | Natural Language Processing; Template Filling; Information Extraction; Clinical Text |
Subjects: | Computer Science > Information retrieval |
DCU Faculties and Centres: | Research Initiatives and Centres > Centre for Next Generation Localisation (CNGL) DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing |
Publisher: | CEUR-WS |
Official URL: | http://ceur-ws.org/Vol-1180/ |
Copyright Information: | © 2014 The Authors |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
ID Code: | 20112 |
Deposited On: | 29 Sep 2014 12:37 by Liadh Kelly . Last Modified 25 Oct 2018 14:33 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
244kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record