Logo Lanfrica

Mpilenhle-cmd/Hackathon

Domaine:

natural language processing

Type de record:

project
Créateur:
Mpi
Hôte:
Predicting the type of language in South Africa using machine learning # Hackathon Predicting the type of language in South Africa using machine learning With the problem requiring us to differentiate the type of Language Each And every text is represented in. The best option for this problem is to go for the Bag of word system for features, cause I believe every word in a language is important, and as there are simillar words in the South African Language that are used by different languages. That means a use of ngrams can be really helpful. The SVC Linear and the Naive Bayes show great perfomance, they actually stand out from others. I chose to investigate further about their perfomance. I used the Grid Search to find the best C and best Gamma, I used alpha for the Naive Bayes. With a great perfomance from the SCV Linear it was not too well compared to the Naive Bayes of alpha 0.5. And with the use of tfidf Vector I manged to get rid of data with min_df of 2, and a max_df of 0.8 the perfomance really got better Thus the best choice is the Naive Bayes So far