State-of-the-Art Vietnamese Word Segmentation

Domain:

natural language processing

Record type:

papersoftware

Creator:

ConNgoJia

Host:

Word segmentation is the first step of any tasks in Vietnamese language processing. This paper reviews stateof-the-art approaches and systems for word segmentation in Vietnamese. To have an overview of all stages from building corpora to developing toolkits, we discuss building the corpus stage, approaches applied to solve the word segmentation and existing toolkits to segment words in Vietnamese sentences. In addition, this study shows clearly the motivations on building corpus and implementing machine learning techniques to improve the accuracy for Vietnamese word segmentation. According to our observation, this study also reports a few of achivements and limitations in existing Vietnamese word segmentation systems. 2016 2nd International Conference on Science in Information Technology (ICSITech)

Visit

arxiv.org

Early Tashelhiyt Berber word segmentation: the role of the Possible Word Constraint

The Possible Word Constraint (PWC) leads to the rejection of parses that leave out consonantal segme

BERT Meets Chinese Word Segmentation

Chinese word segmentation (CWS) is a fundamental task for Chinese language understanding. Recently,

Representation learning for word segmentation

Around 40% of natural languages have no standardized writing system and are under-resourced, making

A Multi-view Dataset for Vietnamese Word-Level Sign Language Recognition

------------------------------------------------------------------
Basic informati

Unsupervised Word Segmentation from Speech with Attention

We present a first attempt to perform attentional word segmentation directly from the speech signal,