This paper describes the CUNI submission to the WMT 2019 News Translation Shared Task for the low-resource languages: GujaratiEnglish and Kazakh-English. We participated in both language pairs in both translation directions.
Our system combines transfer learning from a different high-resource language pair followed by training on backtranslated monolingual data. Thanks to the simultaneous training in both directions, we can iterate the backtranslation process.
We are using the Transformer model in a constrained submission.