Search AI Products and News

Recently, research teams from several Chinese scientific institutions have launched the super large-scale multimodal dataset named Infinity-MM, and based on this dataset, they have trained an outstanding AI model called Aquila-VL-2B. This breakthrough injects new momentum into the development of multimodal AI. The Infinity-MM dataset is astonishing in size, containing four major types of data: 10 million image descriptions, 24.4 million general visual instruction data, 6 million selected high-quality instruction data, and 3 million generated by G

Apple Inc. recently launched a significant update for its multimodal AI model MM1, upgrading it to version MM1.5. This upgrade represents more than just a simple change in version number; it is a comprehensive enhancement of capabilities, showcasing the model's stronger performance across various fields. The core upgrade of MM1.5 lies in its innovative data processing methods. The model utilizes a data-centric training approach, carefully selecting and optimizing the training dataset. Specifically, MM1.5 employs high-definition OCR data and synthetic image descriptions, along with optimizations.

Recently, Apple's AI research team launched their next-generation family of Multimodal Large Language Models (MLLMs) - MM1.5. This series of models can integrate various data types such as text and images, showcasing new capabilities of AI in understanding complex tasks. Tasks like visual question answering, image generation, and multimodal data interpretation can be better addressed with the help of these models. A major challenge for multimodal models is how to achieve effective interaction between different data types. Previous models often struggled in this aspect.

Salesforce has released an open source multimodal AI model named xGen-MM, designed to simultaneously understand and generate various data types such as text and images, significantly changing the way AI research and applications are conducted. The model performs exceptionally well in multiple benchmark tests, demonstrating strong performance compared to similar open source models, and includes pretrained models, datasets, and fine-tuning code. The largest model boasts 4 billion parameters and can handle 'interleaved data,' enabling multitasking, such as answering questions about multiple images at once. The diverse options available in the model reflect the potential of AI.