A 4-bit quantized version of the google/gemma-2b model compressed using AWQ technology, designed to enhance inference efficiency and reduce resource consumption.

Natural Language ProcessingTransformers

PrunaAI's compressed version of the UniNER-7B-all model, significantly reducing memory usage and energy consumption through quantization techniques while maintaining good named entity recognition capabilities.

Natural Language ProcessingTransformers

PrunaAI-optimized 8-bit quantized version of Palmyra small language model, significantly reducing memory usage and energy consumption

Natural Language ProcessingTransformers

PrunaAI's compressed MPT-7B story-writing model, enabling efficient inference through llm-int8 technology

Natural Language ProcessingTransformersOther

A compressed version of the MPT-7B-Chat model provided by PrunaAI, optimized with llm-int8 technology to significantly reduce memory usage and energy consumption.

Natural Language ProcessingTransformersOther