Search AI Products and News

Recently, the Beijing Academy of Artificial Intelligence (BAEI), in collaboration with Shanghai Jiao Tong University and other institutions, officially released a new generation of ultra-long video understanding model - Video-XL-2. The introduction of this model represents a significant breakthrough in the field of open-source ultra-long video understanding technology, injecting new vitality into the development of multimodal large models for understanding long video content. In terms of technical architecture, Video-XL-2 mainly consists of three core components: a visual encoder, the Dynamic Token Synthesis (DTS) module, and a large language model (LLM). The model adopts

A research team from New York University, MIT, and Google has recently proposed an innovative framework aimed at addressing the bottleneck of inference time scaling in diffusion models. This groundbreaking research transcends the traditional method of simply increasing the denoising steps, opening up new avenues for improving generative model performance. The framework primarily unfolds from two dimensions: one is leveraging feedback from validators, and the second is implementing algorithms to discover better noise candidates. The research team builds on a pre-trained SiT-XL model with a resolution of 256×256, maintaining 250 fixed denoising steps.

Stability AI has released a new AI model called Stable Zero123, which can generate high-quality 3D object views from a single image. Stable Zero123 significantly outperforms its predecessor, Zero123-XL, thanks to three key innovations. It uses a rigorously curated training dataset sourced from Objaverse, specifically retaining high-quality images.

The Beijing ZhiYuan Artificial Intelligence Research Institute, in collaboration with Shanghai Jiao Tong University, Renmin University of China, Peking University, and Beijing University of Posts and Telecommunications, has launched an ultra-long video understanding model named Video-XL. This model is an important demonstration of the core capabilities of multimodal large models and a key step towards General Artificial Intelligence (AGI). Compared to existing multimodal large models, Video-XL shows superior performance and efficiency in processing long videos exceeding 10 minutes.

["Over 24 hours since the launch of Claude 3, it continues to reshape people's perceptions.", "Netizens believe that Claude 3 behaves as if it has a 'coherent subject' existence, unlike other large models.", "Some OpenAI users suggest that if Claude continues to showcase its capabilities, it might push OpenAI to release its next-generation model.", "Jimmy Apples releases the latest news, indicating that OpenAI's risk/reward assessment regarding the release of the next-generation model may be influenced by Claude 3."]

Good research does not fade away; it only becomes more relevant over time. In the past week, OpenAI's video generation model Sora has continued to attract attention. The team has launched a new version, SiT, which further improves quality, speed, and flexibility. The latest paper, "Scalable Diffusion Models with Transformers", has been recognized at ICCV2023, leading the advancement of technology. SiT explores a broader design space through interpolation, bringing new possibilities to the field of image generation.