This is the GGUF quantized version of the large language model Mistral-Large-3-675B-Instruct-2512 developed by Mistral AI. The original model has 675 billion parameters and is designed for instruction-following tasks. This project uses the llama.cpp tool and combines it with the imatrix calibration dataset to generate more than 20 different precision quantized model files from Q8_0 to IQ1_S, aiming to balance model performance, inference speed, and storage/memory usage, enabling it to run on a wider range of hardware.

Natural Language ProcessingGgufMultiple Languages

This model is an MLX format conversion version of the Ministral-3-3B-Instruct-2512 instruction fine-tuning model released by Mistral AI. It is a large language model with a parameter scale of 3B, specifically optimized for following instructions and dialogue tasks, and supports multiple languages. The MLX format enables it to run efficiently on Apple Silicon devices.

Natural Language ProcessingMlxMultiple Languages

Trouper-12B GGUF is a text generation model developed by DarwinAnim8or based on the original model. It is specifically optimized for role-playing and creative writing scenarios. This model is fine-tuned from Mistral-Nemo-Base-12B and trained using a custom 'Actors' dataset. The generated text is more natural and avoids the common 'AI language' features.

Natural Language ProcessingGgufEnglish

This is a statically quantized GGUF version of the Manoghn/voicecraft-mistral-7b model, based on the Mistral-7B architecture, specifically designed for content generation and text generation tasks. This version offers multiple quantization levels, ranging from 2.8GB to 14.6GB. Users can choose the appropriate version according to their hardware conditions and performance requirements.

Natural Language ProcessingTransformersEnglish

This is a quantized image-text-to-text model based on the Mistral architecture, with a parameter scale of 24B. It is specifically optimized and trained for instruction following tasks and supports multimodal input processing.

MultimodalGguf

This is a quantized version based on the SicariusSicariiStuff/Hebrew_Nemo model, a large language model with the Mistral architecture specifically optimized for Hebrew, supporting text generation and dialogue tasks in Hebrew and English.

Natural Language ProcessingTransformersMultiple Languages

Lodos-24B-Instruct-2510 is a large Turkish language model fine-tuned based on Mistral-Small-3.2-24B-Instruct-2506. It uses the TRL framework for full supervised fine-tuning and is specifically optimized for Turkish instruction following tasks, supporting long text generation and complex reasoning.

Natural Language ProcessingTransformersOther

This is a 24B parameter efficient inference model built on Mistral Small 3.2 and converted to MLX-MXFP4 format. The model has enhanced inference capabilities, supports multimodal input, has a 128k context window, and can run on an RTX 4090 or a MacBook with 32GB RAM.

MultimodalMlxMultiple Languages

This is a quantized version of unsloth/Mistral-Small-3.2-24B-Instruct-2506. By quantizing the weights and activation functions to the FP4 data type, it reduces the disk size and GPU memory requirements while supporting vLLM inference. It has been evaluated on multiple tasks to compare the quality with the non-quantized model.

Natural Language ProcessingSafetensorsMultiple Languages

This is a Japanese pre - trained language model based on the Mistral 300M architecture. It is trained using the Wikipedia and cc100 datasets, and the byte - fallback technique in the SentencePiece tokenizer is adopted to suppress the generation of unknown words.

Natural Language ProcessingTransformers

ConfTuner-Ministral is a quantized large language model based on the Mistral architecture, specifically fine-tuned for trustworthy AI scenarios, supporting text generation and confidence estimation functions. The model offers multiple quantized versions suitable for different resource-constrained environments.

Natural Language ProcessingTransformersEnglish

This is a static quantized version of the liushiliushi/ConfTuner-Ministral model, suitable for text generation and confidence estimation tasks. This model is based on the Mistral architecture and has been fine-tuned to provide reliable AI outputs. It supports multiple quantization levels to meet different hardware requirements.

Natural Language ProcessingTransformersEnglish

This is a quantized version of the MistralAI Magistral Small 2509 model, quantized using the imatrix technology of llama.cpp. While maintaining relatively good performance, this version significantly reduces the model's memory usage and computational resource requirements, enabling it to run in various hardware environments.

Natural Language ProcessingGguf

This is a quantized version of mistralai/Mistral-7B-Instruct-v0.3, offering multiple quantization levels to balance between file size and model quality. It supports usage based on llama-cpp and gguf-my-repo.

Natural Language ProcessingTransformers

Magnolia-v3-medis-remix-12B-GGUF is a 12B parameter quantized model merged based on the mergekit technology. It uses Mistral Nemo as the main component and incorporates medical fine-tuning as a noise component. It is suitable for text generation tasks and uses the Apache 2.0 license.

Natural Language ProcessingTransformers

This is a large language model with 24B parameters based on the Mistral architecture, converted to the GGUF format via llama.cpp. The model supports multilingual interaction and is specially optimized for instruction following capabilities, suitable for various text generation and understanding tasks.

Natural Language ProcessingGgufMultiple Languages

Cthulhu is a large model fusion project based on Mistral Small v3.2 and v3.1. It is a super powerful 24B parameter language model created by fusing multiple cutting-edge fine-tuned models. It has octopus-like multifaceted features, providing uncensored creative text generation capabilities, and excels in prose writing, instruction following, and esoteric knowledge expression.

Natural Language ProcessingTransformersEnglish

Cthulhu 24B 1.1 GGUF is a large language model fused based on the Mistral Small series of models, integrating 17 different model components. It has the capabilities of creative writing, uncensored dialogue, and rich language interaction. Inspired by the Cthulhu mythos, this model aims to provide a'super fusion' experience that goes beyond the capabilities of a single model.

Natural Language ProcessingTransformersEnglish

Devstral-Small-2507-AWQ is a quantized version derived from the mistralai/Devstral-Small-2507 model. It uses the AutoAWQ technology for 4-bit quantization and is optimized for efficient operation on the vLLM inference engine.

Natural Language ProcessingSafetensorsOther

Magistral Small 1.1 is a high - efficiency reasoning model with 24 billion parameters, built on the basis of Magistral Small 3.1. It has new reasoning capabilities, supports multiple languages, and uses the Apache 2.0 license. It can be locally deployed and run on a single RTX 4090 or a MacBook with 32GB of memory.

Natural Language ProcessingGgufMultiple Languages