Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

Arabic Sentence Segmentation Across Genres and Punctuation Conditions

Domaine:

natural language processing

Type de record:

paperdatasetmodelsoftware
Créateur:
ElkElmHabAlh
Hôte:avatar
Sentence segmentation in Arabic is challenging due to ambiguous and inconsistent punctuation, with many texts lacking reliable sentence boundary markers. Existing approaches rely heavily on punctuation cues and are typically evaluated on well-formed text, limiting their robustness in realistic Arabic settings. To address this, we introduce AraSEG, a genre-diverse sentence segmentation corpus spanning eight genres and a wide range of punctuation and document structure conditions. Using AraSEG, we evaluate LLMs, lightweight encoder models, and dependency parser-based models under increasingly challenging segmentation settings. Our experiments show that lightweight encoders, and even dependency parser-based models, outperform LLMs in the most challenging settings. We further investigate the effects of training data size and genre diversity, finding that performance eventually saturates and cross-genre generalization remains challenging. We also demonstrate that accurate sentence segmentation substantially improves downstream dependency parsing. We make our code, data, and models publicly available.

Visit

arxiv.org

Tasks

sentence segmentation

Tags

Computation and Language

Similaires

Sentence-Level Automatic Speech Segmentation for AmharicUsing Contextual Information for Sentence-level Morpheme SegmentationSubword Segmental Machine Translation: Unifying Segmentation and Target Sentence GenerationEnhancing Amharic Sentence Segmentation with Prosodic Features and Neural Network ModelsLanguage shift and sentence processing in Moroccan ArabicBasic Sentence Structure in Sudanese Arabic

Sentence-Level Automatic Speech Segmentation for Amharic

Using Contextual Information for Sentence-level Morpheme Segmentation

Recent advancements in morpheme segmentation primarily emphasize word-level segmentation, often negl

Subword Segmental Machine Translation: Unifying Segmentation and Target Sentence Generation

Subword Segmental Machine Translation: Unifying Segmentation and Target Sentence Generation

Poster presented at the Deep Learning Indaba 2023 by Francois Meyer

Enhancing Amharic Sentence Segmentation with Prosodic Features and Neural Network Models

This study focuses on developing a sentence-level automatic speech segmentation system for Amharic.

Language shift and sentence processing in Moroccan Arabic

Basic Sentence Structure in Sudanese Arabic