Within the MT and NLP communities, English is by far the most resource-rich language. MT systems are most often trained to translate texts from and to English or they use English as a pivot language to translate between resource-poorer languages. The interest in English is reflected, for example, in the WMT translation tasks (e.g. News, Biomedical) which have always included language pairs in which texts are translated to and/or from English.
With the widespread use of MT technology, there is more and more interest in training systems to translate between languages other than English. One evidence of this is the need of directly translating between pairs of similar languages. The main challenge here is how to take advantage of the similarity between languages to overcome the limitation given the low amount of available parallel data to produce an accurate output.
Given the interest of the community in this topic we organize, for the first time at WMT, a shared task on "Similar Language Translation" to evaluate the performance of state-of-the-art translation systems on translating between pairs of languages from the same language family. We provide participants with training and testing data from three language pairs: Spanish - Portuguese (Romance languages), Czech - Polish (Slavic languages), and Hindi - Nepali (Indo-Aryan languages). Evaluation will be carried out using automatic evaluation metrics and human evaluation.
The training and dev sets are available here.
To receive the test data, available on April 10, please fill out the registration form.
Evaluation will be done automatically and, depending on the number of submissions, by human judgements too.
Manual Scoring: We will collect subjective judgments about translation quality from human annotators. If you participate in the shared task, we ask you to perform a defined amount of evaluation per language pair submitted. The amount of work required for the manual evaluation will be approximately 4 hours.
We expect the translated submissions to be in recased, detokenized, XML format, just as in most other translation campaigns (WMT News, NIST, TC-Star).
|Release of training/dev data||February 24, 2019|
|Test data released||April 10, 2019|
|Submission deadline||April 17, 2019|
|System description paper deadline||May 15, 2019|
|Notifications||June 10, 2019|
|Camera-ready||June 17, 2019|