8GB VRAM Can Also Handle 128K Ultra-Long Context! Open-Source Local Large Model Tool Strata 0.2.10 Released
Open-source local AI tool Strata releases version 0.2.10, specially optimized for consumer-grade GPUs. This update focuses on lowering the VRAM threshold, improving inference speed, and optimizing multi-GPU collaboration, making it easier for ordinary computers to run hundred-billion-parameter large models. The highlight is a significant reduction in VRAM usage: 8GB graphics cards can also support a 128K ultra-long context, whereas previously enabling contexts above 64K with 8GB VRAM was often restricted. Overall, it makes local large model deployment more accessible and efficient.