Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Lost in translation: the problems of using mainstream MT evaluation metrics for sign language translation

Morrissey, Sara and Way, Andy orcid logoORCID: 0000-0001-5736-5930 (2006) Lost in translation: the problems of using mainstream MT evaluation metrics for sign language translation. In: SALTMIL 2006 - 5th SALTMIL Workshop on Minority Languages, 23 May 2006, Genoa, Italy.

Abstract
In this paper we consider the problems of applying corpus-based techniques to minority languages that are neither politically recognised nor have a formally accepted writing system, namely sign languages. We discuss the adoption of an annotated form of sign language data as a suitable corpus for the development of a data-driven machine translation (MT) system, and deal with issues that arise from its use. Useful software tools that facilitate easy annotation of video data are also discussed. Furthermore, we address the problems of using traditional MT evaluation metrics for sign language translation. Based on the candidate translations produced from our example-based machine translation system, we discuss why standard metrics fall short of providing an accurate evaluation and suggest more suitable evaluation methods.
Metadata
Item Type:Conference or Workshop Item (Poster)
Event Type:Workshop
Refereed:Yes
Uncontrolled Keywords:sign language;
Subjects:Computer Science > Machine translating
DCU Faculties and Centres:Research Initiatives and Centres > National Centre for Language Technology (NCLT)
DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Official URL:http://www.lrec-conf.org/lrec2006/rubrique.php3?id...
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:Irish Research Council for Science Engineering and Technology, IBM
ID Code:15283
Deposited On:11 Mar 2010 12:07 by DORAS Administrator . Last Modified 16 Nov 2018 11:16
Documents

Full text available as:

[thumbnail of MorrisseyWay_saltmil_06.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
358kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record