DeepL voice translation launches Aure model

1. 17:39
   Hacker News AI

   DeepL unveils Aure, its most lifelike Voice AI translation model yet

   DeepL announced Aure, a new Voice AI model powering DeepL Voice that continuously adapts translated speech to reflect shifts in tone, emotion, emphasis and pace, building on the company's earlier voice preservation technology. Aure analyzes incoming speech continuously using both translated words and source audio, and DeepL says it combined training techniques separating voice identity, prosody and spoken content with reinforcement learning. The capabilities apply automatically across DeepL Voice for Online Meetings, In-Person Conversations and the DeepL API for Voice, initially supporting English, German, Spanish, French, Italian, Japanese, Portuguese and Korean.

1. 21:50
   The Decoder

   DeepL wants real-time translation to finally capture sarcasm and mood shifts

   DeepL's new Aure model for DeepL Voice transfers tone, emotion, emphasis, and speaking pace from the original speaker into the target language by continuously analyzing both the translated text and original audio, unlike the earlier approach that used a static voice sample. Reinforcement learning keeps accents out of the output, and Aure runs automatically in DeepL Voice for Online Meetings, In-Person Conversations, and the DeepL API, launching with support for English, German, Spanish, French, Italian, Japanese, Portuguese, and Korean. The article also notes DeepL's earlier voice preservation rollout in September, its May restructuring that cut about 250 jobs, its acquisition of the Mixhalo team, and Block's Dessa speech model for detecting emotions and sarcasm.

Trends compare the same fully observed participants, which may cover fewer participants than current activity. Move the pointer or tap the chart to inspect hourly activity; use the left and right arrow keys with a keyboard.