geofact-x/GeoFact-X

GeoFact-X is a benchmark of geography-aware multilingual reasoning, proposed in the paper, Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning. TL;DR: We introduce M2A and GeoFact-X to evaluate and improve multilingual reasoning in LLMs by aligning internal reasoning with the input language using language-consistency rewards. Project page: jd730.github.io