We present a pilot study of machine transla- tion of selected grammatical contrasts between Czech and English in WMT18 News Transla- tion Task. For each phenomenon, we run a dedicated test which checks if the candidate translation expresses the phenomenon as ex- pected or not.
The proposed type of analysis is not an evaluation in the strict sense because the phenomenon can be correctly translated in var- ious ways and we anticipate only one. What is nevertheless interesting are the differences be- tween various MT systems and the single ref- erence translation in their general tendency in handling the given phenomenon.