Please use this identifier to cite or link to this item:
Title: A Comparison of several Deep Learning based Models for Diacritic Restoration Problem in Vietnamese Text
Authors: Tran, Quang Linh
Lam, Gia Huy
Duong, Van Binh
Vuong, Cong Dat
Do, Trong Hop
Keywords: Diacritic Restoration
Neuron Network
Machine Translation
Natural Language Processing
Word Tokenization
Issue Date: 2021
Publisher: Da Nang Publishing House
Abstract: Diacritic restoration is a challenging problem in natural lan- guage processing (NLP). With diacritic restoration, one can text faster and easier. Diacritic restoration is also helpful in making use of diacritic- missing texts, which are normally discarded in many NLP applications. This paper deals with the diacritic restoration problem for Vietnamese text. Three state-of-the-art deep learning models including Gated Re- current Unit, Bidirectional Long-short Term Memory and Bidirectional Gated Recurrent Unit have been examined for the problem and the last one turned out to be the best among them. Besides deep learning models, it was found in this paper that word tokenization, which is the final pre-processing step applied on the data before feeding it to deep learning models also have influences on the final accuracy. Between two examined word tokenization methods: morpheme-based tokenization and phrasebased tokenization, the former yield better results regardless of the applied deep learning models. The experimental results show that the combination of morpheme-based tokenization and Bidirectional-GRU achieve the best performance of diacritic restoration with the Bleu-score of 88.06%.
Description: The 10th Conference on Information Technology and its Applications; Topic: Image and Natural Language Poster; pp. 65-74.
Appears in Collections:CITA 2021

Files in This Item:

 Sign in to read

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.