Lexical ambiguity resolver tool using word embedding
# Amharic lexical Ambiguity Resolver using Word embedding (or Word sense disambiguation, WSD)
# linguistic ambiguity
linguistic ambiguity exist @ various level such as semantic, syntactic, lexical/word, and so on. This repository focuses on Amharic word-level ambiguity and presents a method for resolving it. Words can have more than one distinct meaning, and many words can be interpreted in different ways depending on the context. Automatically determining the correct sense of an ambiguous word is critical for many applications such as machine translation and information retrieval. To date, the majority of Amharic sense disambiguation work has been unsupervised/ knowledge base and based on WordNet. However, this approach has limitations in that the full Amharic WordNet is not available and manually preparing takes time and resources. To address the aforementioned limitations, we propose a novel joint supervised and unsupervised sense disambiguation approach (SSD + USSD) based on distributional semantic space. Each approach, as well as the combined approach, is assessed using a total of 10 ambiguous words. **The supervised approach achieved 82.3 % of the F1-score and 70% accuracy, while the unsupervised approach achieved 85.7 % of the F1-score and 60% accuracy. The joint approach achieved an F1-score of 92.5 % and an accuracy of 86%**.
# The repository consists of:
Lexical Ambugity resolver algorithim using python language
sample ambiguous words dataset
Image of tool architecture
# The code consists the following activities:
1) Pre-processing Amharic sentence
2) Feature extracting
3) Word2vec lookup
4) Supervised sense disambiguation (SSD)
5) Unsupervised sense disambiguation (USSD)