The Low-Resource Double Bind: An Empirical Study of Pruning for Low-Resource Machine Translation
A “bigger is better” explosion in the number of parameters in deep neural networks has made it increasingly challenging to make state-of-the-art networks accessible in compute-restricted environments. Compression techniques have taken on renewed importance as a way