Multilingual Biosecurity Safety Evaluation of Open-Weight Language Models: Evidence from African Languages

Domain:

natural language processing

Record type:

paper

Creator:

Fat

Publisher:

Host:

This project evaluates the biosecurity related capabilities and safety behaviors of large language models across English, Hausa, and Swahili. By comparing model responses to the same biosecurity prompts in different languages, the study investigates whether safety safeguards, refusals, and scientific knowledge remain consistent across the different linguistic contexts. The goal is to identify potential multilingual safety gaps and contribute to more globally representative AI biosecurity evaluations.

EthioLLM: Multilingual Large Language Models for Ethiopian Languages with Task Evaluation

Large language models (LLMs) have gained popularity recently due to their outstanding performance in

Controlled Evaluation of Syntactic Knowledge in Multilingual Language Models

Language models (LMs) are capable of acquiring elements of human-like syntactic knowledge. Targeted

Controlled Evaluation of Syntactic Knowledge in Multilingual Language Models

This benchmark is made up of "targeted syntactic evaluation tests for three low-resource languages (

HealMed: Multilingual Evaluation of Large Language Models in Medicine

We present HealMed, an expert-reviewed benchmark for multilingual evaluation of large language model

Responsibly Building Multilingual Language Models for Hundreds of Languages

Large Language Models (LLMs) have emerged as a transformative innovation in artificial intelligence,

Continually Adding New Languages to Multilingual Language Models

Multilingual language models are trained on a fixed set of languages, and to support new languages,

Multilingual Biosecurity Safety Evaluation of Open-Weight Language Models: Evidence from African Languages

Domain:

Record type:

Visit

Languages

Licenses

Similar

EthioLLM: Multilingual Large Language Models for Ethiopian Languages with Task Evaluation

Controlled Evaluation of Syntactic Knowledge in Multilingual Language Models

Controlled Evaluation of Syntactic Knowledge in Multilingual Language Models

HealMed: Multilingual Evaluation of Large Language Models in Medicine

Responsibly Building Multilingual Language Models for Hundreds of Languages

Continually Adding New Languages to Multilingual Language Models