Increasing linguistic diversity in NLP : Fine-tuning Multilingual Pre-trained African Language Models Poster presented at the Deep Learning Indaba 2023 by Fiskani Banda
Multilingual pre-trained language models (PLMs) have demonstrated impressive performance on several downstream tasks for both high-resourced and low-resourced languages. However, there is still a large performance drop for languages unseen during pre-training, espe
Massively multilingual pre-trained language models, such as mBERT and XLM-RoBERTa, have received sig
The use of social media in East Africa has grown rapidly, and with it, the spread of hate speech has
A first set of African Language Embeddings
Recent work has shown that Pre-trained Language Models (PLMs) store the relational knowledge learned