Search AI Products and News

Recently, the VITA-MLLM team announced the launch of VITA-1.5, an upgraded version based on VITA-1.0, aimed at enhancing the real-time and accuracy of multimodal interaction. VITA-1.5 not only supports English and Chinese but also achieves significant improvements in multiple performance metrics, providing users with a smoother interaction experience. In VITA-1.5, the interaction delay has been greatly reduced from 4 seconds to just 1.5 seconds, making it almost imperceptible for users during voice interactions.

Tencent's YouTu Lab and other institutions have released the first open source multimodal large language model VITA, aimed at bridging the gap in processing Chinese dialects. Based on the Mixtral8×7B model, VITA expands the Chinese vocabulary and undergoes bilingual instruction fine-tuning, mastering both English and Chinese. Key features include: 1. **Multimodal Understanding**: VITA can handle video, images, text, and audio, which is unprecedented among open source models. 2. **Natural Interaction**: No specific wake words are required, allowing for instant response while maintaining polite and non-intrusive communication.