Step 5 Preview: 600B Sparse MoE Only Activates 27B, Pushing the Cost-Effectiveness Boundary of Open-Source Flagships Further
Step5Preview, a fully open flagship base model for real-world agentic tasks, uses a sparse MoE architecture to push the Pareto frontier across capability, efficiency, and cost. With 600B total parameters, it activates fewer per inference to balance performance and cost.....