Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

NarrativeWorldBench: A Frontier-Saturated Benchmark and a Latent World Model for Long-Horizon Co-Creative Audio Drama

Domaine:

natural language processing

Type de record:

paperdataset
Créateur:
ManRahSaiKaz
Hôte:avatar
Long-form serialized audio drama, with arcs that run for 200 to 800 episodes, is a major creative medium and a setting where frontier large language models (LLMs) fail. We benchmark 21 models, spanning classical, fine-tuned, open-frontier, closed-frontier, and reasoning tiers, on a uniform set of structural narrative metrics. All closed-frontier systems saturate at a plot-beat F1 in the band [0.78, 0.81] and collapse by about -0.20 F1 at horizon h=200. We introduce NarrativeWorldBench, an open benchmark of nine narrative-structure metrics evaluated across horizons h in {10, 20, 50, 100, 200}, with cross-lingual evaluation across four Indic languages (Hindi, Tamil, Telugu, Marathi). We introduce N-VSSM, a Narrative Variational State-Space Model that maintains a structured 256-dimensional latent world state over more than 200 episodes via a Mamba-2 backbone with an event-conditioned posterior and an 8B decoder. N-VSSM holds plot-beat F1 >= 0.84 across all horizons at 4x lower compute than the closed-frontier band. A learned Cultural Transfer Function lifts cross-language fidelity by +0.20 to +0.23 Likert points. In a within-subjects writer study (n = 12 professional authors, 240 trials), N-VSSM is preferred over Claude Opus 4.5 on long-arc consistency 71% of the time and rated +1.3 Likert points higher on controllability. 10 pages. Accepted to the ICML 2026 Workshops on High-dimensional Learning Dynamics (HiLD) and Culture x AI

Visit

arxiv.org

Languages

VunjoZimba

Tags

Computation and LanguageArtificial IntelligenceMachine Learning

Similaires

Approaches to Educational Drama as a Creative Field of Learning for Young Learners in Uyo, Akwa Ibom StateGlobeAudio: A Multilingual Multicultural Benchmark for Naturalistic Evaluation of Large Audio-Language ModelsProductive efficiency of beef cattle production in Botswana: a latent class stochastic meta-frontier analysisAkhara: A Study on a Style-Conditioned Latent Diffusion Model for Khmer Handwriting SynthesisAfriEconQA: A Benchmark Dataset for African Economic Analysis based on World Bank ReportsSet-Valued Control Approach Applied to a COVID-19 Model with Screening and Saturated Treatment Function

Approaches to Educational Drama as a Creative Field of Learning for Young Learners in Uyo, Akwa Ibom State

This paper examined the three different approaches to educational drama which are: Creative Drama an

GlobeAudio: A Multilingual Multicultural Benchmark for Naturalistic Evaluation of Large Audio-Language Models

Large Audio-Language Models (LALMs) integrate audio perception and language understanding within a u

Productive efficiency of beef cattle production in Botswana: a latent class stochastic meta-frontier analysis

Introduction Efficiency in food production is crucial for sustainable agriculture in developing cou

Akhara: A Study on a Style-Conditioned Latent Diffusion Model for Khmer Handwriting Synthesis

Khmer, which is a language spoken by more than 16 million speakers, is considered a low-resource lan

AfriEconQA: A Benchmark Dataset for African Economic Analysis based on World Bank Reports

We introduce AfriEconQA, a specialized benchmark dataset for African economic analysis grounded in a

Set-Valued Control Approach Applied to a COVID-19 Model with Screening and Saturated Treatment Function

The purpose of this paper is modelling and controlling the spread of COVID-19 disease in Morocco. A