Amazon Prime Video’s new AI tech matches lips to dubbed audio
TL;DR
Maxton Hall. | Image: Prime Video Amazon's Prime Video is launching a new AI-powered feature that lines up an actor's mouth with "human-dubbed" audio. The feature is only available with the English dub of the German series Maxton Hall for now, but Prime Video plans to expand it to "additional titles" in the future. In its announcement, Prime Video says it uses a combination of AI and visual effects technologies to make lip movements match up with translated speech.
Nauti's Take
Lip-synced dubs remove the biggest barrier for international series, and starting with a German production shows the potential for content outside the English-language market. The catch is quality: in close-ups every mismatch is obvious, and voice talent loses control over how their own image moves.
Teams distributing video internationally should test this now, while performers should get facial usage rights nailed down in their contracts.
Sources