Search AI Products and News

CASIC introduces Stream-Omni, a multimodal model supporting text, vision, and speech. It uses targeted alignment to reduce data dependency, excels in cross-modal tasks, and offers open-source resources.....

Well-known e-commerce host Luo Yonghao announced via Weibo on June 12 that his digital persona will start live-streaming for sales on the Baidu e-commerce platform on June 15, inviting old friends to come and serve as "human verification tools" at that time. This has drawn attention from the industry. Previously, Luo Yonghao conducted his first live stream on Baidu e-commerce on May 23, breaking RMB 50 million in GMV (Gross Merchandise Value) within 4 hours with over ten million viewers, demonstrating his strong appeal. It is understood that Luo Yonghao is the first top host to try live-streaming sales using a digital person.

On March 27th, Alibaba launched its first multimodal large model, Qwen2.5-Omni-7B. This model boasts powerful capabilities, handling various input modalities such as text, images, audio, and video, and generating text and natural speech outputs in real-time. This innovative technological breakthrough marks another significant advancement for Alibaba in the field of artificial intelligence. In the authoritative OmniBench multimodal fusion task benchmark, Qwen2.5-Omni achieved...

The Alibaba Cloud Tongyi Qianwen Qwen team announced the launch of Qwen2.5-Omni, a new generation of end-to-end multimodal flagship model in the Qwen family. Designed for comprehensive multimodal understanding, this new model seamlessly handles various input formats including text, images, audio, and video, and generates text and natural speech synthesis outputs simultaneously via real-time streaming response.

On March 11th, the Tongyi Lab team announced the open-sourcing of the R1-Omni model, marking a significant advancement in multimodal model development. This model integrates reinforcement learning with verifiable reward (RLVR) methods, focusing on improving reasoning capabilities and generalization performance in multimodal emotion recognition tasks. R1-Omni's training is divided into two stages. In the cold-start phase, the team fine-tuned the model using a combined dataset containing 580 video clips sourced from Explainable Multimodal Emotion...

Recently, in Hangzhou, Zhejiang, the rise of the AI tool DeepSeek has seen increasing numbers of entrepreneurs leveraging its powerful capabilities for profit. News of a Gen Z streamer generating 330 million Yuan in sales in a single day using DeepSeek for a live stream has attracted significant attention. Reports indicate that many businesses and individuals have experimented with new sales methods with the help of DeepSeek. For example, a business owner from Yiwu successfully sold out their entire inventory using DeepSeek.

Domestic artificial intelligence company Wenwen Xinqun has announced the open sourcing of its latest developed end-side full-modal understanding AI model — Megrez-3B-Omni. This model is the world's first open source project of its kind, marking the company's innovative development in the AI field. At the same time, Wenwen Xinqun also launched a pure language version of the model, Megrez-3B-Instruct, to further enrich its product line. Founded in May 2023, the founding team comes from the Department of Electronic Engineering at Tsinghua University. The company is committed to creating efficiency.

In the digital age, content safety issues are becoming increasingly important. On September 26, OpenAI officially launched a new multimodal content moderation model named 'omni-moderation-latest'. This model is based on the latest GPT-4o technology and can accurately identify harmful text and images. This update will provide developers with powerful tools to build more robust moderation systems. A highlight of the new model is its ability to moderate both text and image inputs, especially when handling non...

Westlake Xincheng announces the open-source release of its Westlake-Omni model. As the world's first open-source Chinese emotional end-to-end speech interaction model, Westlake-Omni utilizes discrete representation to unify text and speech modalities, with a particular focus on real-time capabilities, enabling quick responses and providing an almost zero-latency experience.

Following OpenAI's GPT-4 achieving remarkable results in traditional mathematics assessments, the research teams from Peking University and Alibaba have jointly launched a brand new evaluation benchmark - Omni-MATH, aimed at assessing the reasoning abilities of large language models at the level of the Olympic mathematics competitions. This initiative not only provides a new standard for evaluating AI mathematics capabilities but also opens up new avenues for exploring AI's potential in advanced mathematics. The unique design of Omni-MATH includes a database of 4,428 competition-level mathematics problems.

Baidu Intelligent Cloud showcased its latest advancements in the traffic big model sector at the 2024 China International Big Data Industry Expo. By integrating with Baidu's traffic big data, it significantly enhanced the efficiency of omni-directional signal control, improving traffic flow by 20-30%. In the pilot project in Guiyang's Guanshanhu District, the application of AI signal control technology led to a 15% reduction in average weekday vehicle delay. This system integrates internet and local traffic police data to predict traffic flow distribution within 5 minutes and dynamically adjusts traffic light durations to optimize green light utilization.

AI face-swapping technology, known as Deepfake, has gradually become widespread against the backdrop of rapid technological advancement, attracting significant attention. A strikingly realistic live stream video of Musk has sparked heated discussions online, drawing a large audience and revealing the potential and risks of the technology. Deepfake technology is not only used for live streams but can also create highly realistic social media videos, such as a fake Musk TikTok account, which has garnered an impressive number of likes and shares, making it hard to distinguish truth from falsehood. However, the application of this technology has also led to a series of issues, particularly the increased risk of telecommunication fraud.