Unsupervised acoustic word embeddings evaluated on Buckeye English and NCHLT Xitsonga data in Python 3.
Unsupervised Acoustic Word Embeddings on Buckeye English and NCHLT Xitsonga
===========================================================================
Overview
--------
**Note:** This is an updated version of the recipe at
kamperh/recipe_bucktsong_awe. The code here uses Python 3
(instead of Python 2.7) and uses LibROSA for feature extraction (instead of
HTK). Because of slight differences in the resulting features, the results here
does not exactly match those in the paper below, since the older recipe was
used for the paper.
Unsupervised acoustic word embedding (AWE) approaches are implemented and
evaluated on the Buckeye English and NCHLT Xitsonga speech datasets. The
experiments are described in:
- H. Kamper, "Truly unsupervised acoustic word embeddings using weak top-down
constraints in encoder-decoder models," in *Proc. ICASSP*, 2019.
[arXiv]
Please cite this paper if you use the code.
Disclaimer
----------
The code provided here is not pretty. But I believe that research should be
reproducible. I provide no guarantees with the code, but please let me know if
you have any problems, find bugs or have general comments.
Download datasets
-----------------
Portions of the Buckeye English and NCHLT Xitsonga corpora are used. The whole
Buckeye corpus is used and a portion of the NCHLT data. These can be downloaded
from:
- Buckeye corpus:
buckeyecorpus.osu.edu
- NCHLT Xitsonga portion:
www.zerospeech.com.
This requires registration for the challenge.
From the complete Buckeye corpus we split off several subsets: the sets
labelled as `devpart1` and `zs` respectively correspond to the `English1` and
`English2` sets in Kamper et al., 2016. We
use the Xitsonga dataset provided as part of the Zero Speech Challenge 2015 (a
subset of the NCHLT data).
Create and run Docker image
---------------------------
This recipe provides a Docker image containing all the required dependencies.
The recipe can be run without Docker, but then the dependenci …