Search AI Products and News

The AI visual generation platform Higgsfield has launched another major feature - "Speak", bringing unprecedented convenience to digital human content creators. Users only need three steps: select preset actions, upload custom roles, and input voice text, to generate digital human videos with lip-sync and natural actions. The Speak feature supports precise lip-sync technology, ensuring that the character's pronunciation is natural and synchronized, along with 16 built-in scene types covering diversified content styles such as interviews, explanations, advertisements, and short plays, greatly enhancing creation.

AI video research company Tavus recently released Hummingbird-0, its latest zero-shot lip synchronization model, hailed as the current State-of-the-Art (SOTA) in lip-sync technology. The model is now available for research preview on the Tavus platform, API, and FAL, generating significant interest within the AI content creation field. Hummingbird-0 represents a breakthrough in zero-shot lip synchronization, built upon Tavus' flagship model Phoenix-

AI technology company Sync Labs recently announced via Twitter the launch of its latest product, Lipsync-2, touted as the world's first zero-shot lip-sync model. It retains the speaker's unique style without requiring additional training or fine-tuning. This breakthrough technology boasts significant improvements in realism, expressiveness, control, quality, and speed, suitable for real-person videos, animation, and AI-generated content. Lipsync-2's innovative features are based on Sync Lab's...

Heygem is an open-source alternative to HeyGen, offering precise cloning of appearance and voice, and supporting lip-sync for realistic video generation.

Kuaishou Technology Co., Ltd. announced that its independently developed visual generation large model, Kling AI, has completed a new round of capability upgrades. The upgraded Kling AI API has achieved significant improvements in virtual fitting and lip-syncing, providing stronger technical support for clients in e-commerce, advertising marketing, pan-entertainment, and AI tools.

Beijing Aishi Technology Co., Ltd. has announced the global release of its latest version of the video generation large model, PixVerse V3. This version has made significant improvements in its underlying model capabilities, offering multimodal generation abilities and a wealth of AI features, including creative templates, lip synchronization, story continuation, and style transformation.

Baidu AI has recently launched a new feature that allows users to directly import files from Baidu Wangpan into the Wenxin Yiyan platform. This update greatly simplifies the process of uploading and managing files for users, enabling quicker access and processing of various documents stored in the cloud.

D-ID has recently launched AI Video Translate, an innovative AI video translation tool that can translate video content into multiple languages, clone the speaker's voice, and adjust lip movements to ensure that the translated content perfectly matches the visuals. This tool supports batch rendering in 29 languages and features a user-friendly interface, making it easy for anyone to use. Through this technology, D-ID helps clients promote marketing, entertainment, and social media activities globally, saving on localization costs. The launch of this technology is significant for small creators.

ByteDance and a research team from Shanghai University of Science and Technology have developed an innovative technology called 'HeadGAP' that can quickly generate highly realistic and animatable 3D virtual head models using just three photos taken from different angles, enabling facial expression synchronization. During the research process, the team first extracted 3D head prior information from a large multi-view dynamic dataset to customize the virtual avatar for the target individual. By utilizing a Gaussian point cloud-based self-decoding network and partial dynamic modeling, in conjunction with inversion and fine-tuning strategies, they efficiently achieved high-quality and diverse...

ByteDance's latest CLASI system is a powerful tool for cross-language communication, designed for real-time translation. Its core technology includes a robust language model and an information retrieval system, enabling near real-time, accurate, and fluent translations that understand professional terminology and maintain contextual memory for coherence. CLASI also features self-learning capabilities to handle unclear audio or vague expressions e....

PIKA releases lip sync feature, Alibaba launches video generation framework EMOEMO that can create speaking videos of any length as AI video generation tools continue to optimize their technology.

Alibaba's EMO and OpenAI Sora's text-to-video models are gaining popularity. The EMO framework enhances the realism and naturalness of top video generation. EMO allows for the creation of dynamic, expressive AI character avatars. The EMO method supports the generation of songs and spoken audio in different languages, enabling interaction between various characters.