Popović, Maja ORCID: 0000-0001-8234-8745 (2021) On nature and causes of observed MT errors. In: Proceedings of Machine Translation Summit XVIII: Research Track, 16-20 Aug 2021, Online.
Abstract
This work describes analysis of nature and causes of MT errors observed by different evaluators under guidance of different quality criteria: adequacy and comprehension and and a not specified generic mixture of adequacy and fluency. We report results for three language pairs and two domains and eleven MT systems. Our findings indicate that and despite the fact that some of the identified phenomena depend on domain and/or language and the following set of phenomena can be considered as generally challenging for modern MT systems: rephrasing groups of words and translation of ambiguous source words and translating noun phrases and and mistranslations. Furthermore and we show that the quality criterion also has impact on error perception. Our findings indicate that comprehension and adequacy can be assessed simultaneously by different evaluators and so that comprehension and as an important quality criterion and can be included more often in human evaluations.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Conference |
Refereed: | Yes |
Subjects: | Computer Science > Machine translating |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing Research Initiatives and Centres > ADAPT |
Published in: | Proceedings of Machine Translation Summit XVIII: Research Track. . Association for Machine Translation in the Americas. |
Publisher: | Association for Machine Translation in the Americas |
Official URL: | https://aclanthology.org/2021.mtsummit-research.14 |
Copyright Information: | © 2020 Association for Machine Translation in the Americas |
Funders: | European Association for Machine Translation through its 2019 sponsorship of activities programme, Science Foundation Ireland Research Centres Programme (Grant13/RC/2106), European Regional Development Fund. |
ID Code: | 28359 |
Deposited On: | 23 May 2023 14:06 by Maja Popovic . Last Modified 31 May 2023 14:11 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
339kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record