Published
Jun 27, 2024
Updated
Jun 27, 2024

Can AI Explain and Fix Bad Translations?

xTower: A Multilingual LLM for Explaining and Correcting Translation Errors
By
Marcos Treviso|Nuno M. Guerreiro|Sweta Agrawal|Ricardo Rei|José Pombal|Tania Vaz|Helena Wu|Beatriz Silva|Daan van Stigt|André F. T. Martins

Summary

Machine translation has come a long way, but even the best systems can still produce errors. Researchers have developed a new large language model (LLM) called xTower, designed to not only correct these errors but also explain why they happened in the first place. xTower builds upon TowerBase, an open-source LLM, and provides free-text explanations for translation errors. Imagine getting a translation that misses the mark; xTower could pinpoint the problematic phrases and tell you exactly why they're wrong, perhaps explaining a cultural nuance or a tricky word sense. This is achieved by using a combination of expert human feedback and an automatic error detection tool. Expert translators tested xTower's explanations and found them helpful for understanding the errors and improving translations. Specifically, in tests translating between English and German, the tool's explanations were praised for their usefulness. The model then uses this explanation in a chain-of-thought process to suggest a corrected translation. Interestingly, even when the initial error detection was wrong, xTower could sometimes still offer helpful feedback by identifying other areas for potential improvement. In experiments across multiple language pairs, xTower significantly improved translation quality compared to other LLMs. But it's not always about replacing the original translation. Sometimes the original is good enough, especially with high-quality MT systems. So, the researchers developed a hybrid approach where xTower only steps in to correct the text when the initial translation quality is low. This clever strategy makes the whole system more efficient. This research is an important step toward not just improving translation quality, but also making AI more transparent and trustworthy. By understanding *why* the machine made a mistake, users can have more confidence in the final result. Future work could focus on generalizing this approach to more languages and integrating it with more sophisticated error-detection tools.
🍰 Interesting in building your own agents?
PromptLayer provides the tools to manage and monitor prompts with your whole team. Get started for free.

Question & Answers

How does xTower's chain-of-thought process work to correct translation errors?
xTower uses a two-step process combining error detection and explanation-based correction. First, it identifies translation errors using both automated tools and expert human feedback to pinpoint problematic phrases. Then, it generates a detailed explanation of why the error occurred (e.g., cultural nuances or word sense issues) and uses this explanation in a chain-of-thought process to produce an improved translation. For example, if a German idiom is translated literally to English, xTower would explain the cultural context behind the idiom and suggest a more appropriate English equivalent that captures the intended meaning.
What are the main benefits of AI-powered translation explanation systems?
AI-powered translation explanation systems offer three key benefits: transparency, learning potential, and improved accuracy. They help users understand why translation errors occur rather than just correcting them blindly, building trust in the AI system. For businesses, this means better quality control in international communications. For language learners, it provides valuable insights into common translation pitfalls and cultural nuances. The technology can be particularly useful in high-stakes situations like legal or medical document translation where understanding the reasoning behind translations is crucial.
Why is combining human expertise with AI important in language translation?
Combining human expertise with AI in translation creates a more reliable and nuanced translation system. Human experts provide crucial cultural context, idiomatic understanding, and quality verification that AI might miss, while AI offers speed and consistency at scale. This hybrid approach ensures translations maintain both accuracy and cultural appropriateness. In practical applications, this combination is especially valuable for businesses expanding globally, where both efficiency and cultural sensitivity are essential. It also helps in developing more sophisticated translation tools that can better understand context and nuance.

PromptLayer Features

  1. Testing & Evaluation
  2. The paper's evaluation approach using expert translators and automated error detection aligns with PromptLayer's testing capabilities
Implementation Details
Set up systematic A/B testing between original and corrected translations, implement scoring metrics based on expert feedback, create regression tests for translation quality
Key Benefits
• Quantifiable translation quality improvements • Systematic error detection and tracking • Reproducible evaluation framework
Potential Improvements
• Integration with more language pairs • Custom scoring metrics for different translation contexts • Automated expert feedback collection
Business Value
Efficiency Gains
Reduced time in translation quality assessment through automated testing
Cost Savings
Decreased reliance on manual translation review
Quality Improvement
More consistent and reliable translation outputs
  1. Workflow Management
  2. xTower's chain-of-thought process for translation correction matches PromptLayer's multi-step orchestration capabilities
Implementation Details
Create reusable templates for error detection and correction, implement version tracking for translation improvements, establish RAG system for explanation generation
Key Benefits
• Structured translation improvement pipeline • Traceable correction history • Reusable correction patterns
Potential Improvements
• Enhanced template customization • Better integration with existing translation systems • More sophisticated correction chains
Business Value
Efficiency Gains
Streamlined translation correction process
Cost Savings
Optimized resource allocation for translation tasks
Quality Improvement
More consistent translation correction workflows

The first platform built for prompt engineering