Search AI Products and News

Recently, Alibaba Cloud's Qwen series of AI large language models has seen significant progress. Support for its next-generation model, Qwen3, has been officially merged into the vLLM (efficient large language model inference framework) codebase. This news has sparked heated discussions in the tech community, signaling that Qwen3's release is imminent. It is understood that Qwen3 will include at least two versions: Qwen3-8B and Qwen3-MoE-15B-A2B, representing innovative attempts at different scales and architectures, for developers and enterprises.

Magic搭 Community collaborates with vLLM and FastChat to provide efficient LLM inference and deployment services. Developers can use vLLM as the inference engine in FastChat, offering high-throughput model inference. FastChat is an open platform for training, serving, and evaluating LLM-based ChatBots. vLLM is an LLM service developed by researchers from the University of California, Berkeley, Stanford University, and the University of California, San Diego.