The WMT'18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English
2018
Abstract
Progress in the quality of machine translation output calls for new automatic evaluation pro- cedures and metrics. In this paper, we ex- tend the Morpheval protocol introduced by Burlot and Yvon (2017) for the English-to- Czech and English-to-Latvian translation di- rections to three additional language pairs, and report its use to analyze the results of WMT 2018's participants for these language pairs.
Considering additional, typologically varied source and target languages also enables us to draw some generalizations regarding this morphology-oriented evaluation procedure.