The awkwardness caused by language barriers in watching foreign films and TV shows will soon become a thing of the past. On September 9 local time, Amazon officially announced through a press release that its streaming platform Prime Video has fully launched a new AI lip-syncing feature. This technology can accurately align the actors' mouth movements with the dubbed audio tracks, completely solving the long-standing issue of mismatch between visuals and sound in cross-language dubbing.
As the global launch project for this feature, the technology is currently first available for the English dubbed version of the popular German series "Elite: The Gap Between Us." Subscribers around the world can now experience this new audio-visual effect in the first and second seasons of the show. Additionally, Amazon confirmed that the third season, set to premiere on December 9, will also support this AI lip-syncing feature, and it will gradually be expanded to more films and TV shows in the future.
In terms of technical implementation, Prime Video's innovation integrates cutting-edge artificial intelligence and visual effects technologies, ensuring that the facial expressions of actors match perfectly with the translated dialogue they speak. Notably, as generative AI becomes increasingly prevalent in the video industry, the entire sector is actively investing in this area. For example, Meta and YouTube have recently introduced AI-based automatic dubbing features for creators, complete with "lip-sync" options, allowing characters in videos to appear as if they are speaking directly in the language preferred by the audience.
