Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

What changes when you randomly choose BPE merge operations? Not much

Domaine:

natural language processing

Type de record:

papersoftware
Créateur:
SälLig
Hôte:avatar
We introduce three simple randomized variants of byte pair encoding (BPE) and explore whether randomizing the selection of merge operations substantially affects a downstream machine translation task. We focus on translation into morphologically rich languages, hypothesizing that this task may show sensitivity to the method of choosing subwords. Analysis using a Bayesian linear model indicates that two of the variants perform nearly indistinguishably compared to standard BPE while the other degrades performance less than we anticipated. We conclude that although standard BPE is widely used, there exists an interesting universe of potential variations on it worth investigating. Our code is available at: github.com. A slightly-extended version of the paper accepted at the EACL 2023 Workshop on Insights from Negative Results in NLP

Visit

arxiv.org

Tasks

machine translation

Tags

Computation and LanguageArtificial Intelligence

Similaires

Too much of a good thing: When transitional justice prescriptions may not workSix dimensions of research trial acceptability: how much, what, when, in what circumstances, to whom and why?“You get what you appreciate”Batazia | Enjoy books and learning in any African language you choosenoah4xek1dblog/How-Much-You-Need-To-Expect-You-ll-Pay-For-A-Good-fashionnoah4xek1dblog/How-Much-You-Need-To-Expect-You-ll-Pay-For-A-Good-ricardohardouin

Too much of a good thing: When transitional justice prescriptions may not work

Transitional justice developed as a pragmatic concept prescribing a set of mechanisms to be used by

Six dimensions of research trial acceptability: how much, what, when, in what circumstances, to whom and why?

Ethics guidelines emphasise that research should be acceptable to the people invited to take part. H

“You get what you appreciate”

Purpose The purpose of this study is to examine the influences of transactional and transformationa

Batazia | Enjoy books and learning in any African language you choose

Batazia brings a world of books, stories and learning into African languages, and gives you indigenous literature in the language you speak. The Batazia Goodie Batazia gives you the ability to instantly transform any existing book, story or learning material on it

noah4xek1dblog/How-Much-You-Need-To-Expect-You-ll-Pay-For-A-Good-fashion

By far the most remarkable clearly show at this June's Pitti Uomo collections in Florence was a pres

noah4xek1dblog/How-Much-You-Need-To-Expect-You-ll-Pay-For-A-Good-ricardohardouin

The most outstanding show at this June's Pitti Uomo collections in Florence was a presentation title