This is an open-source large language model with 20 billion parameters focusing on the field of network security. It is based on the GPT-OSS architecture and fine-tuned by integrating multiple network security instruction datasets. The model provides various quantization versions, which are convenient for deployment in resource-constrained environments and can be used to generate network security-related texts, codes, and analysis reports.

Natural Language ProcessingTransformersEnglish

This is a quantized version of TheDrummer's Magidonia-24B-v4.3 large language model. By using the imatrix quantization technology of llama.cpp, GGUF format files with various precisions from BF16 to IQ2_XS are generated, aiming to run the model more efficiently under different hardware conditions (especially in resource-constrained environments) while maintaining the model performance as much as possible.

Natural Language ProcessingGguf

This project is a quantized version of TheDrummer's Cydonia-24B-v4.3 model. It uses llama.cpp for quantization processing, aiming to provide model files of different quantization types to meet the needs of different hardware and performance. It is a large language model with 24B parameters, mainly used for text generation tasks.

Natural Language ProcessingGguf

This is the GGUF quantization format version of the NousResearch/Hermes-4.3-36B model, quantized by MaziyarPanahi. GGUF is an efficient model format designed to optimize local deployment and inference performance, supporting multiple quantization levels (2-bit to 8-bit), and suitable for a wide range of text generation tasks.

Natural Language ProcessingGguf

Qwen3-4B-Hivemind-Instruct-NEO-MAX-Imatrix-GGUF is a large language model with 4B parameters for instruction fine-tuning based on the Qwen3 architecture. It uses NEO Imatrix and MAX quantization technologies and has the ability to process an ultra-long context of 256k. This model performs excellently in multiple benchmark tests and is a powerful general-purpose model.

Natural Language ProcessingGgufEnglish

This is the quantized version of Qwen3-VL-32B-Thinking-heretic, using a new ablation method for quantization. Compared with traditional methods, it causes less damage to the base model. It offers multiple quantization precision versions and is suitable for running on devices with 24GB of VRAM, supporting image-to-text tasks.

MultimodalTransformersEnglish

An optimized image generation model based on black-forest-labs/FLUX.2-dev, supporting image-to-image generation and editing tasks. It uses fp8_scaled quantization technology to improve inference speed and is particularly suitable for use on low-VRAM GPUs.

This is a quantized version of the Microsoft Fara-7B model, optimized using the imatrix technology of llama.cpp. The model supports multiple quantization levels, from high-precision bf16 to extremely low-precision IQ2_M, meeting the needs of different hardware configurations and performance requirements.

Natural Language ProcessingGguf

This is the GGUF quantized version of ArliAI's GLM-4.5-Air-Derestricted model. It uses llama.cpp and imatrix technology for optimized quantization processing, offering multiple quantization levels to suit different hardware configurations and performance requirements.

Natural Language ProcessingGguf

This is a quantized version of the squ11z1's Hypnos-i1-8B model, which is quantized using the llama.cpp tool and a specific dataset. The model is based on the Llama-3 architecture, offering multiple quantization type options and supporting text generation tasks. It is suitable for various application scenarios such as inference and dialogue.

Natural Language ProcessingGgufEnglish

This is an experimental quantized large language model that uses the Deckard (qx) quantization method with 3-bit quantization for the embedding layer. The model is reconstructed using the Norm-Preserving Bi-Projection Elimination (NPBA) technique, which not only removes the security restriction mechanism but also enhances the model's cognitive depth and reasoning ability.

Natural Language ProcessingMlx

This is a version of the Qwen3-Next-80B large language model after 4-bit quantization using Huawei's SINQ (Sinkhorn Normalized Quantization) method. SINQ is a novel, fast, and high-quality quantization method designed to significantly compress the model size (by approximately 75%) while maintaining almost the same accuracy as the original model, making it easier to deploy.

Natural Language ProcessingSafetensorsEnglish

Gemma 3 is a lightweight open-source multimodal model launched by Google. This version is an instruction-tuned quantization-aware training model with 12B parameters, which has been converted to the MXFP4 format of the MLX framework. It supports text and image input and generates text output, with a 128K context window and support for over 140 languages.

MultimodalMlx

This is a quantized version of the MiroThinker-v1.0-8B model developed by miromind-ai. It is quantized using specific tools and datasets, providing users with files of various quantization types to choose from and can run in different environments to meet different performance and quality requirements.

Natural Language ProcessingGgufEnglish

This is a quantized version of TheDrummer's Snowpiercer-15B-v4 model, quantized using llama.cpp and imatrix technology. This version offers multiple quantization levels from BF16 to IQ2_S, meeting the needs of users with different hardware conditions and performance requirements. The model is calibrated and optimized using a specific dataset and supports the online repackaging function to improve performance on ARM and AVX hardware.

Natural Language ProcessingGguf

GLM-4.5-Air-REAP-82B-A12B-mxfp4-mlx is a large language model with 82B parameters compressed by the REAP method based on the GLM-4.5-Air model. It uses the MXFP4 quantization format and is optimized for Mac devices, significantly reducing memory usage while maintaining the performance of core tasks.

Natural Language ProcessingMlxEnglish

This is a quantized version of ai-sage's GigaChat3-10B-A1.8B model, using the imatrix quantization technology of llama.cpp, which can run more efficiently under different hardware conditions. The model supports Russian and English and is mainly used for text generation tasks.

Natural Language ProcessingGgufMultiple Languages

The quantized GGUF version of Tencent's Hunyuan Video 1.5 model, specifically designed for text-to-video generation tasks, supports 720P HD video generation, and offers multiple quantization precision versions to optimize usage efficiency.

MultimodalGguf

This is the GGUF quantized version of allenai's Olmo-3-32B-Think model. It undergoes various quantization processes using the llama.cpp tool, aiming to enhance the model's performance and efficiency in specific environments. It offers multiple quantization options from Q2 to Q8 to meet different hardware configurations and performance requirements.

Natural Language ProcessingGgufEnglish

The quantized GGUF version of Tencent's Hunyuan Video 1.5 model, specifically designed for image-to-video and video generation tasks. It offers distilled and standard models with a 480P resolution and supports multiple quantization precisions, including Q4_K_S, Q8_0, and FP16, etc.

MultimodalGguf