Charles Explorer logo
🇬🇧

Outbound Translation User Interface Ptakopet: A Pilot Study

Publication at Faculty of Mathematics and Physics |
2020

Abstract

It is not uncommon for Internet users to have to produce a text in a foreign language they have very little knowledge of and areunable to verify the translation quality.We call the task "outbound translation" and explore it by introducing an open-sourcemodular system Ptakopvet. Its main purpose is to inspect human interaction with MT systems enhanced with additional subsystems,such as backward translation and quality estimation.

We follow up with an experiment on (Czech) human annotators tasked toproduce questions in a language they do not speak (German), with the help of Ptakopvet. We focus on three real-world use cases(communication with IT support, describing administrative issues and asking encyclopedic questions) from which we gain insight intodifferent strategies users take when faced with outbound translation tasks.

Round trip translation is known to be unreliable for evaluat-ing MT systems but our experimental evaluation documents that it works very well for users, at least on MT systems of mi