Microsoft files patent for real-time word modification and lip redrawing
Understand this story
Microsoft has submitted patent application US 2026/0341309 A1, intending to use AI to identify and replace filler words such as "um," slang, or inappropriate terms in live audio and video, while redrawing the speaker's lip movements so the visuals match the rewritten speech, with a delay of about 1–10 seconds. The system decides what to rewrite based on user profile (age, language, location); a separate independent claim covers real-time translation, which can replace languages outside the user profile with translated text and synchronize lip movements. The patent states that the system can run on AR glasses, phones, tablets, or cameras, using on-device chips for processing. Examiners have already rejected the existing claims in the first examination, which is standard procedure and is usually followed by amendments to the claims.
AI overview based on source reports · Updated 57 min ago
Coverage timeline
Follow the coverage to explore different perspectives.
- Hacker News AIAI Live Speech Rewriting Patent
Microsoft has filed a patent application (US 2026/0341309 A1) for a system that uses AI to identify and replace words in live speech based on a user profile, then redraws the speaker's mouth in the video so the lips match, with short blended transitions hiding the seams. The same setup could act as a translator, swapping words in languages missing from the profile and redrawing lips to match, with a delay of a few seconds. The filing names AR glasses, phones, tablets and video cameras as possible devices, and notes the examiner's first review rejected the claims as filed.
Activity for this story
Not enough continuous observations to show a trend yet.