This is an experimental mixed quantization model that uses the MXFP4_MOE mixed weight technology. While maintaining accuracy close to Q8, it achieves a smaller file size and higher inference speed. The model explores the combination of MXFP4 with high-precision embedding/output weights and achieves near-lossless optimization of accuracy on dense models.

Natural Language ProcessingGgufOther

This is a lightweight version of the ByteDance Seed-OSS-36B-Instruct model quantized to 4 bits using DWQ. It is distilled from the BF16 teacher model using mlx-lm 0.27.1 and supports Chinese-English bilingual text generation tasks.

Natural Language ProcessingMlxMultiple Languages

This is a static quantization version of the ByteDance-Seed/Seed-OSS-36B-Instruct model, providing GGUF format files with multiple quantization levels to help developers use the model more efficiently under different hardware configurations.

Natural Language ProcessingGguf

Seed-OSS-36B-Instruct is a large language model developed by ByteDance-Seed, with 36 billion parameters and released under the Apache 2.0 open-source license. This model is built on the transformers library, supports vllm and mlx technology optimization, and has undergone 8-bit quantization specifically for Apple Silicon chips, providing efficient text generation capabilities.

Natural Language ProcessingTransformers

Seed-OSS-36B-Instruct is a large language model with 36 billion parameters developed by the ByteDance Seed team. It is built on the Transformer architecture, processed with MLX quantization, and specifically optimized for Apple Silicon chips. It can run efficiently in LM Studio.

Natural Language ProcessingTransformers

This is a quantized version of the Seed-OSS-36B-Instruct model from ByteDance-Seed. It undergoes multi-precision quantization processing using the llama.cpp tool, offering more than 20 quantization options from BF16 to IQ2_XXS, aiming to enhance the model's operating efficiency and performance on different hardware.

Natural Language ProcessingGguf

Seed-OSS is an open-source large language model series developed by the ByteDance Seed team. It has powerful long context processing, reasoning, and agent interaction capabilities. Trained with only 12T tokens, it performs excellently in multiple public benchmark tests and supports native long context processing of up to 512K.

Natural Language ProcessingTransformers

Seed OSS 36B Instruct is a large-scale language model developed by ByteDance, with 36 billion parameters, specifically optimized for instruction-following tasks. It is built on the llama.cpp framework and supports efficient text generation capabilities.

Natural Language ProcessingGguf

Seed-OSS-36B-Instruct is a large language model with 36 billion parameters developed by ByteDance and is open-sourced under the Apache-2.0 license. This model is specifically optimized for instruction following tasks, supporting text generation and dialogue functions, and has powerful understanding and generation capabilities.

Natural Language ProcessingGguf

Seed-OSS-36B-Instruct is a text generation model developed by ByteDance. It is based on a large language model architecture with a 36B parameter scale and is specifically optimized for instruction-following tasks. This model supports both English and Chinese and uses the Apache-2.0 open-source license. It can be efficiently deployed through the vllm and mlx inference frameworks.

Natural Language ProcessingMlxMultiple Languages

Seed-OSS-36B-Instruct is a large-scale language model developed by ByteDance, with 36 billion parameters, focusing on text generation tasks. This model is implemented based on the MLX framework, supports both English and Chinese, and has powerful instruction following and text generation capabilities.

Natural Language ProcessingMlxMultiple Languages

Seed-OSS-36B-Instruct is a large language model with 36 billion parameters developed by ByteDance. It is optimized based on the MLX framework and focuses on text generation tasks. This model supports both English and Chinese, and uses the Apache 2.0 open-source license. It has powerful instruction-following and content generation capabilities.

Natural Language ProcessingMlxMultiple Languages

Seed-OSS-36B-Instruct-AWQ is a quantized version of the 36B parameter large language model developed by the ByteDance Seed team. It has powerful long context processing capabilities, reasoning capabilities, and agent functions, and supports a context length of up to 512K and flexible thinking budget control.

Natural Language ProcessingTransformersMultiple Languages

Seed-OSS is an open-source large language model series developed by the ByteDance Seed team. It has powerful long context processing, reasoning, agent interaction capabilities, and general performance. This model was trained with only 12T tokens and performed excellently in multiple public benchmark tests.

Natural Language ProcessingTransformersMultiple Languages