Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Bilingual lexicon induction across orthographically-distinct under-resourced Dravidian languages

Chakravarthi, Bharathi Raja orcid logoORCID: 0000-0002-4575-7934, Rajasekaran, Navaneethan, Arcan, Mihael orcid logoORCID: 0000-0002-3116-621X, McGuinness, Kevin orcid logoORCID: 0000-0003-1336-6477, O'Connor, Noel E. orcid logoORCID: 0000-0002-4033-9135 and McCrae, John P. orcid logoORCID: 0000-0002-7227-1331 (2020) Bilingual lexicon induction across orthographically-distinct under-resourced Dravidian languages. In: 7th Workshop on NLP for Similar Languages, Varieties and Dialects, 13 Dec 2020, Barcelona, Spain (Online).

Abstract
Bilingual lexicons are a vital tool for under-resourced languages and recent state-of-the-art approaches to this leverage pretrained monolingual word embeddings using supervised or semi- supervised approaches. However, these approaches require cross-lingual information such as seed dictionaries to train the model and find a linear transformation between the word embedding spaces. Especially in the case of low-resourced languages, seed dictionaries are not readily available, and as such, these methods produce extremely weak results on these languages. In this work, we focus on the Dravidian languages, namely Tamil, Telugu, Kannada, and Malayalam, which are even more challenging as they are written in unique scripts. To take advantage of orthographic information and cognates in these languages, we bring the related languages into a single script. Previous approaches have used linguistically sub-optimal measures such as the Levenshtein edit distance to detect cognates, whereby we demonstrate that the longest common sub-sequence is linguistically more sound and improves the performance of bilingual lexicon induction. We show that our approach can increase the accuracy of bilingual lexicon induction methods on these languages many times, making bilingual lexicon induction approaches feasible for such under-resourced languages.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Workshop
Refereed:No
Subjects:Computer Science > Computational linguistics
Computer Science > Information retrieval
Computer Science > Machine translating
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing
Research Initiatives and Centres > INSIGHT Centre for Data Analytics
Published in: Proceedings of the 7th Workshop on NLP for Similar Languages, Varieties and Dialects. . International Committee on Computational Linguistics (ICCL).
Publisher:International Committee on Computational Linguistics (ICCL)
Official URL:https://www.aclweb.org/anthology/2020.vardial-1.6
Copyright Information:© 2020 The Authors. CC-BY-4.0
Funders:Science Foundation Ireland (SFI) under Grant Number SFI/12/RC/2289 P2 (Insight 2), European Regional Development Fund, EU H2020 programme under grant agreements 825182 (Pret- ˆ a-` LLOD), Irish Research Council grant IRCLA/2017/129 (CARDAMOM-Comparative Deep Models of Language for Minority and Historical Languages)
ID Code:25223
Deposited On:04 Dec 2020 14:55 by Navaneethan Rajasekaran . Last Modified 03 Feb 2021 13:36
Documents

Full text available as:

[thumbnail of Bilingual Lexicon Induction across Orthographically-distinctUnder-Resourced Dravidian Languages.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
273kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record