Logo Lanfrica
  • Home
  • Atlas
  • Insights
  • Docs
  • Sign in

© 2026 Lanfrica. All rights reserved. All copyrights of the resources shown on the Lanfrica website belong to the original copyright holders, unless explicitly stated otherwise.

Large Reasoning Models Are (Not Yet) Multilingual Latent Reasoners

Domain:

natural language processing

Record type:

paper
Creator:
LiuZhaSchHed
Host:avatar
Large reasoning models (LRMs) achieve strong performance on mathematical reasoning tasks, often attributed to their capability to generate explicit chain-of-thought (CoT) explanations. However, recent work shows that LRMs often arrive at the correct answer before completing these textual reasoning steps, indicating the presence of latent reasoning -- internal, non-verbal computation encoded in hidden states. While this phenomenon has been explored in English, its multilingual behavior remains largely unknown. In this paper, we conduct a systematic investigation of multilingual latent reasoning in LRMs across 11 languages. Using a truncation-based strategy, we examine how the correct answer emerges as the model is given only partial reasoning traces, allowing us to measure stepwise latent prediction formation. Our results reveal clear evidence of multilingual latent reasoning, though unevenly: strong in resource-rich languages, weaker in low-resource ones, and broadly less observable on harder benchmarks. To understand whether these differences reflect distinct internal mechanisms, we further perform representational analyses. Despite surface-level disparities, we find that the internal evolution of predictions is highly consistent across languages and broadly aligns with English -- a pattern suggesting an English-centered latent reasoning pathway. ACL 2026 Findings

Visit

arxiv.org

Tags

Computation and Language

Similar

Language Models are Multilingual Chain-of-Thought ReasonersSoT: Structured-of-Thought Prompting Guides Multilingual Reasoning in Large Language ModelsMultilingual Large Language Models do not comprehend all natural languages to equal degreesEvaluating Multilingual Long-Context Models for Retrieval and ReasoningLarge Language Models are Geographically BiasedDistilling Monolingual Models from Large Multilingual Transformers

Language Models are Multilingual Chain-of-Thought Reasoners

We evaluate the reasoning abilities of large language models in multilingual settings. We introduce

SoT: Structured-of-Thought Prompting Guides Multilingual Reasoning in Large Language Models

Recent developments have enabled Large Language Models (LLMs) to engage in complex reasoning tasks t

Multilingual Large Language Models do not comprehend all natural languages to equal degrees

Large Language Models (LLMs) play a critical role in how humans access information. While their core

Evaluating Multilingual Long-Context Models for Retrieval and Reasoning

Recent large language models (LLMs) demonstrate impressive capabilities in handling long contexts, s

Large Language Models are Geographically Biased

Large Language Models (LLMs) inherently carry the biases contained in their training corpora, which

Distilling Monolingual Models from Large Multilingual Transformers

Although language modeling has been trending upwards steadily, models available for low-resourced la