Poncelas, Alberto ORCID: 0000-0002-5089-1687, Pidchamook, Wichaya, Liu, Chao-Hong ORCID: 0000-0002-1235-6026, Hadley, James and Way, Andy ORCID: 0000-0001-5736-5930 (2020) Multiple segmentations of Thai sentences for neural machine translation. In: Spoken Language Technologies for Under-resourced languages and Collaboration and Computing for Under-Resourced Languages Workshop, (SLTU-CCURL 2020), 11 - 12 May 2020, Marseille, France. (Virtual).
Abstract
Thai is a low-resource language, so it is often the case that data is not available in sufficient quantities to train an Neural Machine Translation (NMT) model which perform to a high level of quality. In addition, the Thai script does not use white spaces to delimit the boundaries between words, which adds more complexity when building sequence to sequence models. In this work, we explore how to augment a set of English–Thai parallel data by replicating sentence-pairs with different word segmentation methods on Thai, as training data for NMT model training. Using different merge operations of Byte Pair Encoding, different segmentations of Thai sentences can be obtained. The experiments show that combining these datasets, performance is improved for NMT models trained with a dataset that has been split using a supervised splitting tool.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Workshop |
Refereed: | Yes |
Additional Information: | Part of LREC 2020 Workshop Language Resources and Evaluation Conference 11-16 May 2020 |
Subjects: | Computer Science > Machine translating |
DCU Faculties and Centres: | DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing DCU Faculties and Schools > Faculty of Humanities and Social Science > School of Applied Language and Intercultural Studies Research Initiatives and Centres > ADAPT |
Published in: | Beermann, Dorothee, Besacier, Laurent, Sakti, Sakriani and Soria, Claudia, (eds.) Proceedings of 1st Joint SLTU and CCURL Workshop (SLTU-CCURL 2020). . LREC. |
Publisher: | LREC |
Official URL: | https://lrec2020.lrec-conf.org/media/proceedings/W... |
Copyright Information: | © 2020 The Authors |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
Funders: | SFI Research Centres Programme (Grant 13/RC/2106), Irish Research Council’s COALESCE scheme (COA- LESCE/2019/117) |
ID Code: | 24440 |
Deposited On: | 11 May 2020 15:10 by Alberto Poncelas . Last Modified 22 Jan 2021 14:24 |
Documents
Full text available as:
Preview |
PDF
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
126kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record