Leveraging Language Models and Machine Learning in Verbal Autopsy Analysis

Domain:

healthcarenatural language processing

Record type:

paper

Creator:

Chu

Host:

In countries without civil registration and vital statistics, verbal autopsy (VA) is a critical tool for estimating cause of death (COD) and inform policy priorities. In VA, interviewers ask proximal informants for details on the circumstances preceding a death, in the form of unstructured narratives and structured questions. Existing automated VA cause classification algorithms only use the questions and ignore the information in the narratives. In this thesis, we investigate how the VA narrative can be used for automated COD classification using pretrained language models (PLMs) and machine learning (ML) techniques. Using empirical data from South Africa, we demonstrate that with the narrative alone, transformer-based PLMs with task-specific fine-tuning outperform leading question-only algorithms at both the individual and population levels, particularly in identifying non-communicable diseases. We explore various multimodal fusion strategies combining narratives and questions in unified frameworks. Multimodal approaches further improve performance in COD classification, confirming that each modality has unique contributions and may capture valuable information that is not present in the other modality. We also characterize physician-perceived information sufficiency in VA. We describe variations in sufficiency levels by age and COD and demonstrate that classification accuracy is affected by sufficiency for both physicians and models. Overall, this thesis advances the growing body of knowledge at the intersection of natural language processing, epidemiology, and global health. It demonstrates the value of narrative in enhancing COD classification. Our findings underscore the need for more high-quality data from more diverse settings to use in training and fine-tuning PLM/ML methods, and offer valuable insights to guide the rethinking and redesign of the VA instrument and interview. Ph.D. dissertation submitted to The Ohio State University, August 2025

Visit

arxiv.org

Tasks

text classification

Using Machine Learning to Fuse Verbal Autopsy Narratives and Binary Features in the Analysis of Deaths from Hyperglycaemia

Lower-and-middle income countries are faced with challenges arising from a lack of data on cause of

Soft-Label Machine Learning for Verbal Autopsy: Incorporating Diagnostic Uncertainty in Cause-of-Death Estimation

Objective: Verbal autopsy (VA) is widely used to infer cause

Comparative Analysis of Machine Learning and Deep Learning Models for Sentiment Analysis in Somali Language

Enhancing Sentiment Analysis for Hausa Language Using Dataset Augmentation and Machine Learning Models

This study focuses on enhancing sentiment analysis for the Hausa language, a low-resource language,

LAVA: Language Model Assisted Verbal Autopsy for Cause-of-Death Determination

Verbal autopsy (VA) is a critical tool for estimating causes of death in resource-limited settings w

Performance evaluation of machine learning and Computer Coded Verbal Autopsy (CCVA) algorithms for cause of death determination: A comparative analysis of data from rural South Africa

Computer Coded Verbal Autopsy (CCVA) algorithms are commonly used to determine the cause of death (C