Logo Lanfrica
  • Accueil
  • Atlas
  • Analyses
  • Documentation
  • Sign in

© 2026 Lanfrica. Tous droits réservés. Tous les droits d'auteur des ressources affichées sur le site Web Lanfrica appartiennent aux détenteurs de droits d'auteur d'origine, sauf indication contraire explicite.

Visually Grounded Speech Models for Low-resource Languages and Cognitive Modelling

Domaine:

natural language processing

Type de record:

paperdataset
Créateur:
Nor
Hôte:avatar
This dissertation examines visually grounded speech (VGS) models that learn from unlabelled speech paired with images. It focuses on applications for low-resource languages and understanding human language acquisition. We introduce a task called visually prompted keyword localisation to detect and localise keywords in speech using images. We demonstrate the effectiveness of VGS models in few-shot learning scenarios for low-resource languages like Yoruba. Additionally, we examine the mutual exclusivity bias in VGS models. Our monolingual VGS model exhibits this bias, but we found that multilingualism does not affect the bias in this VGS model similarly to what is observed in children. PhD Dissertation

Visit

arxiv.org

Tasks

speech processing

Languages

Yoruba

Tags

Computation and LanguageComputer Vision and Pattern Recognition

Similaires

Visually Grounded Keyword Detection and Localisation for Low-Resource LanguagesA Grounded Unsupervised Universal Part-of-Speech Tagger for Low-Resource LanguagesVisually grounded few-shot word learning in low-resource settingsVisually Grounded Reasoning across Languages and CulturesContinual-learning for Modelling Low-Resource Languages from Large Language ModelsOpenBibleTTS: Large-Scale Speech Resources and TTS Models for Low-Resource Languages

Visually Grounded Keyword Detection and Localisation for Low-Resource Languages

This study investigates the use of Visually Grounded Speech (VGS) models for keyword localisation in

A Grounded Unsupervised Universal Part-of-Speech Tagger for Low-Resource Languages

Unsupervised part of speech (POS) tagging is often framed as a clustering problem, but practical tag

Visually grounded few-shot word learning in low-resource settings

We propose a visually grounded speech model that learns new words and their visual depictions from j

Visually Grounded Reasoning across Languages and Cultures

The design of widespread vision-and-language datasets and pre-trained encoders directly adopts, or d

Continual-learning for Modelling Low-Resource Languages from Large Language Models

Modelling a language model for a multi-lingual scenario includes several potential challenges, among

OpenBibleTTS: Large-Scale Speech Resources and TTS Models for Low-Resource Languages

Recent advances in neural text-to-speech (TTS) and multilingual speech generation have substantially