NEW! Try Welocalize’s ChatGPT Plugin, TranslationRater
TranslationRater™ is the First ChatGPT Plugin to evaluate and rate translation output quality. Welocalize, a pioneer of tech enablement within language services, announces the launch of its newest innovation: TranslationRater™, a plugin for ChatGPT. A first in OpenAI’s plugin store for ChatGPT, the new tool allows users to gain insight into the quality of text…
TranslationRater™ is the First ChatGPT Plugin to evaluate and rate translation output quality.
Welocalize, a pioneer of tech enablement within language services, announces the launch of its newest innovation: TranslationRater™, a plugin for ChatGPT. A first in OpenAI’s plugin store for ChatGPT, the new tool allows users to gain insight into the quality of text translations provided by the language model or input by users.
The plugin works in a simple and efficient way. When a user prompts ChatGPT to translate a given text into a specified target language and to rate the translation, the plugin activates to evaluate the quality of the translation. The user will get a translation rating of excellent, good, fair, poor, or terrible.
“Large language models (LLM) will play an important role in future global content and communications. This innovation gives users the ability to assess the quality of the LLM’s multilingual output,” said Chris Grebisz, Welocalize CIO. “Our plugin for ChatGPT helps users navigate through the uncertainty of AI-generated translation quality. By providing feedback on the translation, users have more confidence in the translated content.”
How to Use TranslationRater
The plugin is a tool for ChatGPT Plus users who wish to evaluate the accuracy of translations provided by the language model. It can also be used to evaluate translations that are input into GPT-4 by the user. The plugin does not confirm the factual accuracy of the content, but the quality of the translation.
Three-Step Guide to Installing the Plugin
Step 1: Access the Plugin Store Open the plugin store within ChatGPT, which operates similarly to an app store.
Step 2: Search and Enable the Plugin Search for “Welocalize,” “translation,” or “TranslationRater.” Once you find the plugin, enable it for use.
Step 3: Use the Plugin Whenever you need to evaluate a translation, use prompts like “how good is this translation” or “evaluate this translation.” ChatGPT will activate the Welocalize plugin and provide a quality rating for the translation.
Tools to Guide You Through the AI Disruption
“Generative AI is disrupting content creation, workflows, and business practices. Welocalize is committed to developing new tools to guide our clients through the disruption. Tools like our new plugin for ChatGPT is a further step in that direction,” comments Paul Carr, Welocalize CEO.
Through 2023 and 2024, Welocalize will introduce additional AI integrations and features for ChatGPT and other generative AI models.
About Welocalize
Welocalize, Inc., ranked as one of the world’s largest LSPs by language industry intelligence firms CSA Research, Nimdzi, and Slator, offers innovative language services to help global brands reach audiences around the world in more than 250 languages. The company provides translation and localization services, linguistic talent management, language tools, automation, and technology, quality, and program management.
Its range of managed language services includes machine translation, digital marketing, validation and testing, interpreting, multilingual data training, and enterprise translation management technologies. As a pioneer of tech-enablement within language services and digital transformation, Welocalize is uniquely positioned to help its clients capitalize on recent developments in generative AI.
The following release notes cover changes to Welocalize TranslationRater for ChatGPT and will be updated as updates are released.
Welocalize TranslationRater for ChatGPT
TranslationRater, a plugin for ChatGPT, is designed to allow ChatGPT users to gain more insight into the quality of text translations provided by the language model or input by users.
- Release Version: 1.0
- Release Date: June 19, 2023
RELEASE CONTENTS
- TranslationRater by Welocalize, a plugin for ChatGPT, allows users to gain more insight into the quality of text translations provided by the language model or input by users.
- In this version, we alternate experiments with two models: WMT20 COMET and GPT-3.5 Turbo. Quality scores from both models will be mapped to the following quality labels: EXCELLENT, GOOD, FAIR, POOR and TERRIBLE. The ranges behind the labels will be adjusted over time.
- The Plugin Store is available to all users with the ChatGPT Plus subscription plan.
CHANGE HISTORY
- Welocalize TranslationRater Plugin for ChatGPT
- No changes yet
REFERENCES
Quality Model References for LLM quality Evaluation
- COMET: A Neural Framework for MT Evaluation
- On the Limitations of Cross-lingual Encoders as Exposed by Reference-Free Machine Translation Evaluation
- Large Language Models Are State-of-the-Art Evaluators of Translation Quality
KNOWN ISSUES
- WMT20 COMET returns false negative values for certain language constructs
- Intermittent networking errors
FEATURES
- Prompt for text translation and its evaluation (rating)
- Provide translated text and prompt for evaluation (rating)