This is a quantized version of the MistralAI Magistral Small 2509 model, quantized using the imatrix technology of llama.cpp. While maintaining relatively good performance, this version significantly reduces the model's memory usage and computational resource requirements, enabling it to run in various hardware environments.

Natural Language ProcessingGguf

This is a quantized version of mistralai/Mistral-7B-Instruct-v0.3, offering multiple quantization levels to balance between file size and model quality. It supports usage based on llama-cpp and gguf-my-repo.

Natural Language ProcessingTransformers

Devstral-Small-2507-AWQ is a quantized version derived from the mistralai/Devstral-Small-2507 model. It uses the AutoAWQ technology for 4-bit quantization and is optimized for efficient operation on the vLLM inference engine.

Natural Language ProcessingSafetensorsOther

Magistral Small 1.1 is a high - efficiency reasoning model with 24 billion parameters, built on the basis of Magistral Small 3.1. It has new reasoning capabilities, supports multiple languages, and uses the Apache 2.0 license. It can be locally deployed and run on a single RTX 4090 or a MacBook with 32GB of memory.

Natural Language ProcessingGgufMultiple Languages

An efficient text generation model based on the mistralai/Devstral-Small-2507 model with 4-bit AWQ quantization, specifically optimized for code generation tasks, significantly reducing computational resource requirements while maintaining high-quality output.

Natural Language ProcessingSafetensorsOther

Devstral-Small-2507-AWQ is a 4-bit quantized version based on mistralai/Devstral-Small-2507, optimized using AutoAWQ technology, and designed specifically for efficient text generation tasks.

Natural Language ProcessingSafetensorsOther

This is a quantized version of the MistralAI Devstral-Small-2507 model, quantized using the llama.cpp tool, offering multiple quantization types to meet different hardware and performance requirements.

Natural Language ProcessingGgufMultiple Languages

Devstral-Small-2507 is a small text generation model developed by mistralai. It supports multiple languages and is optimized for Apple chips.

Natural Language ProcessingSafetensorsMultiple Languages

Devstral-Small-2507 is a multilingual text generation model developed by mistralai, supporting multiple languages and is particularly suitable for Apple Silicon devices.

Natural Language ProcessingSafetensorsMultiple Languages

Devstral is an intelligent large language model specifically designed for software engineering tasks, developed in collaboration by Mistral AI and All Hands AI.

Natural Language ProcessingGgufMultiple Languages

Devstral is an intelligent large language model specifically designed for software engineering tasks, developed in collaboration by Mistral AI and All Hands AI. It excels at using tools to explore code repositories, edit multiple files, and provides strong support for software engineering agents.

Natural Language ProcessingSafetensorsMultiple Languages

This is the Llamacpp imatrix quantized version of the Mistral-Small-3.2-24B-Instruct-2506 model, offering various quantization types to meet different hardware requirements.

Natural Language ProcessingGgufMultiple Languages

Mistral-Small-3.2-24B-Instruct-2506 is a minor version update of Mistral-Small-3.1-24B-Instruct-2503, which improves instruction following, reduces repetition errors, and enhances function call capabilities.

MultimodalSafetensorsMultiple Languages

Magistral-Small-2506 is a small and efficient inference model built on Mistral Small 3.1, with 24 billion parameters, supporting multilingual and long-chain reasoning.

Natural Language ProcessingSafetensorsMultiple Languages

This is a 4-bit GPTQ quantized version based on the mistralai/Devstral-Small-2505 model, optimized for consumer-grade hardware.

Natural Language ProcessingSafetensors

Devstral-Small-2505-8bit is an 8-bit quantized model converted from mistralai/Devstral-Small-2505, suitable for the MLX framework and supporting text generation tasks in multiple languages.

Natural Language ProcessingMlxMultiple Languages

Quantized version of Devstral-Small-2505, supporting multilingual text generation tasks, suitable for local deployment and inference.

Natural Language ProcessingGgufMultiple Languages

Devstral-Small-2505-bf16 is an MLX-format model converted from MistralAI's Devstral-Small-2505 model, supporting multiple language processing tasks.

Natural Language ProcessingMlxMultiple Languages

This is a 3-bit quantized version converted from the mistralai/Devstral-Small-2505 model, designed for the MLX framework and supports multilingual text generation tasks.

Natural Language ProcessingMlxMultiple Languages

A lightweight language model developed by mistralai, optimized with 6-bit quantization via the MLX framework, specifically designed for Apple Silicon.

Natural Language ProcessingMlxMultiple Languages