This is a quantized version of the Alibaba Tongyi Deep Research 30B-A3B model. It uses MXFP4_MOE quantization technology and additionally adds imatrix quantization, aiming to optimize model performance and resource utilization efficiency, and is suitable for text generation tasks.

Natural Language ProcessingGguf

An efficient inference model fine-tuned based on Qwen 30B-A3B (MOE), achieving nearly double the speed improvement by reducing the number of experts, supporting multiple quantization formats and a 40K context length.

Natural Language ProcessingTransformers