Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet
2023
Abstract
This paper presents the results of the General Machine Translation Task organised as part of the 2023 Conference on Machine Translation (WMT). In the general MT task, participants were asked to build machine translation sys- tems for any of 8 language pairs (correspond- ing to 14 translation directions), to be evaluated on test sets consisting of up to four different do- mains.
We evaluate system outputs with profes- sional human annotators using a combination of source-based Direct Assessment and scalar quality metric (DA+SQM).