aliaraabi/OptTransformer

Optimizing Transformer for Low-Resource Neural Machine Translation # OptTransformer This repository has been used for the experiments presented in Optimizing Transformer for Low-Resource Neural Machine Translation. It is based on fairseq, however, some details such as embedding dropout are added. # Requirements * Python=3.7.7 * Pytorch=1.5.0 # Installation `git clone github.com` `cd OptTransformer` `pip intall --editable .` # Preprocess will be added soon. # Training will be added soon. # Evaluation will be added soon.