uheal/machine-translation-models

This repository offers an evaluation of machine translation models for healthcare, focusing on languages like Telugu, Hindi, Arabic, and Swahili. It emphasizes accuracy and medical terminology, aiming to enhance medical communication across diverse languages. The dataset used in evaluation is provided. # An Evaluation of Machine Translation Models ## Overview This repo contains the evaluation and analysis of various machine translation models, specifically tailored for healthcare. The objective is to facilitate accurate and efficient translation of medical dialogue from languages (such as Telugu, Arabic, Swahili, etc.) to English and vice versa. The focus is on ensuring the highest possible accuracy and contextual relevance, given the critical nature of medical communications. ## Model Evaluation A comprehensive evaluation framework was implemented to assess the performance of multiple machine translation models. The criteria includes accuracy, context preservation, medical terminology handling, and speed of translation. These factors are crucial in medical settings where precise and timely communication can significantly impact patient care. ### Languages Covered (so far) - **Focus**: Special focus on regional medical terms, attention to dialectal variations and their impact on translation accuracy, Evaluation includes common phrases and terms used in medical dialogue, and contextual medical dialogue. - **Languages**: Telugu, Hindi, Swahili, Arabic ### Key Metrics - **Translation Accuracy**: Measured against a curated dataset of medical dialogue. - **Context Preservation**: Maintaining the original message's context and nuances. - **Terminology Handling**: Effectiveness in translating specialized medical terms. - **Speed**: Translation turnaround time, crucial for real-time medical communication. - **Cost of Deployment**: Make the cost of deployment cost-effective and ease of the implementation. ## Evaluation The dataset used for the evaluation is the .csv file in the repo. ### Evaluation of translation accuracy using Bleu | Model Name | Telugu -> English | Hindi -> English | Swahili -> English | Arabic -> English | Average | |------------------------|-------------------|------------------|--------------------|-------------------|------- …