Tiny Aya Base Blind Spots

This dataset documents blind spots identified in CohereLabs/tiny-aya-base, a multilingual base language model (3.35B parameters, 70+ languages). Each entry contains a prompt, the expected correct output, the model's actual output, and a human annotation of the error type. The model scored 5/18 (28%) on our evaluation prompts. Categories Tested