In this session, we will explore how we evaluated the translation quality of Google’s Gemma model using the MQM framework and a human-in-the-loop review process.
The case study walks through how LLM-generated translations were assessed using structured error typology, how linguistic quality was benchmarked, and how AI-enhanced workflows can combine automated generation with professional post-editing and evaluation.
We’ll discuss:
How MQM works in real-world AI evaluation
What kinds of errors LLMs produce across languages
Where AI performs well — and where it still struggles
How to design scalable human-in-the-loop evaluation workflows
What this means for localization vendors and enterprise buyers
The session is based on a real case study conducted by Alconost’s MT evaluation team using our MQM evaluation tool.
Full case:
https://alconost.mt/mqm-tool/case-studies/translategemma/
With products, entertainment, and services reaching more customers and audiences around the world each year, lives are becoming just a little more similar. People...
In this episode, we dive once more into the world of AI and its impact on the translation and interpretation industry. Our expert guests,...
Join us for a revolutionary episode of The Nimdzi Live Show. We're now diving into uncharted territory with Innovation Manager, Marta Castello from Creative...