MildredN/deepbrainz-blind-spots

Domain:

natural language processing

Record type:

dataset

Creator:

Mil

Host:

This dataset captures blind spots of the DeepBrainz-R1-0.6B model: Model Link. I generated 10 diverse prompts to test the model’s responses against expected answers. The prompts cover factual knowledge, math, language, reasoning, and commonsense questions. This helps highlight where the model may give incorrect or misleading outputs. "What is the capital of Burkina Faso?" "If 10y + 5 = 30, find y."

Visit

huggingface.co

Tasks

commonsense reasoning

SmolLM2 Blind Spots

HuggingFaceTB/SmolLM2-1.7B Used HuggingFace Transformers with AutoModelForCausalLM on Google Colab

tiny-aya-blind-spots

The evaluation of tiny-aya-base on Hausa mathematical reasoning reveals several systematic blind spo

Tiny Aya Base Blind Spots

This dataset documents blind spots identified in CohereLabs/tiny-aya-base, a multilingual base langu

Tiny-Aya-Base Blind Spots Evaluation Dataset

CohereLabs/tiny-aya-base Architecture: Cohere2 (Cohere Command R family) Parameters: ~3B Type: Raw

Unveiling Cultural Blind Spots: Analyzing the Limitations of mLLMs in Procedural Text Comprehension

Despite the impressive performance of multilingual large language models (mLLMs) in various natural

Possibilities for distributed leadership in South African schools: Policy ambiguities and blind spots

Against the background of the recently published Policy on the South African Standard for Principals