Runs Without a GPU! A 40-Core Old Server Goes Head-to-Head with a 2.8-Trillion-Parameter Large Model, with Optane Memory as the Breakthrough Weapon

As AI parameter counts continue to balloon, giant models with trillions of parameters often need expensive high-end GPU clusters to run. Recently, however, an enthusiast shared an extreme test in true geek spirit in a community: using only an old server with no graphics card installed and a 40-core processor, he actually managed to run Moonshot AI's 2.8-trillion-parameter large model Kimi K3.

Pushing Hardware Limits: A Giant Model Meets an Old Server