This project is based on the moonshotai/Kimi-K2-Thinking base model. The original INT4 model is converted into a higher-quality text generation model through a custom anti-quantization script, aiming to make knowledge accessible to everyone.

Natural Language ProcessingGguf

A text generation model implemented based on the MLX library, supporting inference in multiple quantization methods, with distributed computing capabilities, and can run efficiently in the Apple hardware environment.

Natural Language ProcessingMlxEnglish

Kimi-K2-Thinking is a large language model in MLX format converted by mlx-community from the original model of moonshotai. The conversion is carried out using version 0.28.4 of mlx-lm, retaining the chain of thought reasoning ability of the original model.

Natural Language ProcessingMlx

Kimi K2 Thinking is the latest generation of open-source thinking model developed by Moonshot AI. It has powerful deep reasoning ability and tool call function. The model adopts a mixture-of-experts architecture, supports native INT4 quantization, has a 256k context window, and performs excellently in multiple benchmark tests.

Natural Language ProcessingTransformers

This is a high-quality quantized version of Moonshot AI's Kimi-K2-Instruct-0905 model, using the HQ4_K quantization method. It is specifically optimized for inference performance, supports a context length of 75,000, and is suitable for text generation tasks.

Natural Language ProcessingGgufOther

This is the MLX format conversion version of the moonshotai/Kimi-K2-Instruct-0905 model, using the innovative DQ3_K_M dynamic 3-bit quantization technology, specifically optimized for Apple Silicon Mac devices. It significantly reduces memory usage while maintaining performance close to 4-bit quantization.

Natural Language ProcessingMlx

This is a quantized version of the moonshotai/Kimi-K2-Instruct-0905 model, dedicated to making knowledge accessible to everyone. This project provides optimized model weights for easy deployment and use on various hardware.

Natural Language ProcessingGguf

Based on the moonshotai/Kimi-K2-Instruct-0905 base model, a large language model dynamically quantized using the improved MLX 0.26. Through an innovative dynamic quantization strategy, it significantly reduces hardware requirements while maintaining excellent performance and can run efficiently on a single M3 Ultra device.

Natural Language ProcessingMlx

This is the GGUF format quantized version of the moonshotai/Kimi-K2-Instruct-0905 model, using the ik_llama.cpp branch for optimal quantization. The model adopts a mixture of experts architecture, supports Chinese dialogue and text generation tasks, and has been optimized with various quantization schemes to significantly reduce memory usage while maintaining high quality.

Natural Language ProcessingGgufOther

Kimi-K2 Dynamic MLX is a text generation project built on the moonshotai/Kimi-K2-Instruct model, using the optimized MLX library to achieve efficient quantization performance. This model runs on a single M3 Ultra machine with 512GB RAM, supports multiple quantization methods, and shows excellent perplexity metrics in tests.

Natural Language ProcessingMlx

Kimi K2 is an advanced Mixture of Experts (MoE) language model with 32 billion active parameters and 1 trillion total parameters, optimized for intelligent agent capabilities.

Natural Language ProcessingTransformers

Kimi-K2-Instruct-4bit is a 4-bit quantized model converted from moonshotai/Kimi-K2-Instruct, suitable for the MLX framework.

Natural Language ProcessingMlx

Kimi K2 is an advanced Mixture of Experts (MoE) language model with 32 billion active parameters and a total of 1 trillion parameters, optimized for agent capabilities.

Natural Language ProcessingTransformers

Kimi K2 is an advanced Mixture of Experts (MoE) language model with 32 billion active parameters and 1 trillion total parameters, optimized for agent capabilities.

Natural Language ProcessingTransformers