Google earlierAnnounceGoogle has released a major update to its Search and Google Translate apps based on the Gemini AI model, making translation results more "human." It can not only accurately interpret slang and idioms with implied meanings, but also introduce an instant translation function for headphone users that can preserve the speaker's tone.
Say goodbye to machine translation! Gemini helps you understand local slang.
Google says that by incorporating the Gemini model, the new text translation feature can now handle sentences with more "nuanced meanings." Previously, translation apps often produced laughable literal translations when encountering colloquial slang or idioms. This update takes these informal expressions into account, providing more natural and context-aware translations.
This feature will initially launch in the United States and India, supporting translation between English and about 20 other languages (including Chinese, German, Spanish, and Arabic), and will be simultaneously updated for iOS, Android apps, and web versions.
Instant headphone interpretation: Understand the intonation and rhythm of spoken language.
In addition to text, voice translation has also been updated. Google has upgraded its speech-to-speech translation feature, allowing users to hear real-time translations through headphones.
This feature is currently available in beta in the Android version of the translation app in the United States (the iOS version is expected to be released next year). Its biggest feature is that it uses AI to preserve the speaker's tone, emphasis, and cadence, so that users can tell whether the other person is angry or joking even without looking at the screen, and have a clearer understanding of the flow of the conversation.
This feature supports any headphones (not limited to Pixel Buds) and more than 70 languages. This seems to be an intentional attempt to compete with a similar feature in Apple's AirPods Pro 3.
More and more like Duolingo? Further strengthening language learning skills.
Google also seems to want a piece of the language learning market. Following its introduction of [something] into its translation app starting in August of this year...AI-assisted learning toolsLater, this update added a "consecutive check-in" function similar to Duolingo. The system will record how many consecutive days a user practices the language to encourage them to persevere (but it is unknown whether it will continue to "persist" like Duolingo in the form of a lovebird).
In addition, the pronunciation feedback function has been improved, providing more practical pronunciation suggestions. This educational tool will be expanded to 20 countries and regions, including Germany, India, and Sweden.
Analysis: AI is enabling translation to evolve from "understanding what you see" to "understanding what you hear."
In my observation, Google has recently shown a high level of attention to translation.Significant improvementAlthough they started using AI technology very early onImprove translation functionalityHowever, in recent years, generative AI technology has made Google Translate appear more "human" than its previous machine translation performance, while also improving translation accuracy.become taller (Although there are still many differences in language and culture).
This improvement in slang and tone translation demonstrates Google's attempt to leverage Gemini's capabilities to address the long-standing pain point of machine translation lacking "context" and "emotion." When AI begins to understand your unspoken meanings and nuances in tone, the last hurdle in cross-language communication may truly be about to be overcome.
