T Segmenter: A Corpus, a Benchmark, and the Annotation–Pretraining Trade-off for Mizo Sentence Segmentation

Domain:

natural language processing

Record type:

datasetpaper

Creator:

HauHusDawVar

Publisher:

Zenodo

Host:

The first neural sentence segmenter for the low-resource Mizo language.

Visit

Tasks

sentence segmentation

Tags

Mizo sentence segmentation low-resource NLP XLM-RoBERTa CRF

Licenses

Creative Commons Attribution 4.0 International https://creativecommons.org/licenses/by/4.0/legalcode MIT License https://opensource.org/licenses/MIT

Similar

Adapting BERT and AgriBERT for agroecology: A small-corpus pretraining approachTransformer-Based Clinical Annotation of Lung Cancer Reports: A Benchmark and Fine-Tuning Study on a Novel Tunisian CorpusMoroccan Darija Pretraining Corpus for NanochatAmharic Pretraining CorpusCorpus Generation to Develop Amharic Morphological SegmenterSentence-Level Automatic Speech Segmentation for Amharic

Adapting BERT and AgriBERT for agroecology: A small-corpus pretraining approach

Source Agritrop Cirad (https://agritrop.cirad.fr/614086/) * Autres projet

Transformer-Based Clinical Annotation of Lung Cancer Reports: A Benchmark and Fine-Tuning Study on a Novel Tunisian Corpus

Background: Lung cancer causes more deaths than any other malignancy worldwide, accounting for 2.2 m

Moroccan Darija Pretraining Corpus for Nanochat

Parquet shards prepared for nanochat pretraining. 83 train shards 1 validation shard 82,738,910 tra

Amharic Pretraining Corpus

Amharic Pretraining Corpus is a large-scale dataset (~103M) for general amharic language pretraining

Corpus Generation to Develop Amharic Morphological Segmenter

Sentence-Level Automatic Speech Segmentation for Amharic