Popular GitHub Repositories for Quantize Vietocr

聚宝盆(Cornucopia): 中文金融系列开源可商用大模型，并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)

Graph Transforms to Quantize and Retrain Deep Neural Nets in TensorFlow

Quantize weights and activations in Recurrent Neural Networks.

QAT(quantize aware training) for classification with MQBench

??? Instruction Fine-Tuning of Meta Llama 3.2-3B Instruct on Kannada Conversations ??? Tailoring the model to follow specific instructions in Kannada, enhancing its ability to generate relevant, context-aware responses based on conversational inputs. ?? Using the Kannada Instruct dataset for fine-tuning! Happy Finetuning??

[EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs

How to create, train and quantize network, then integrate it into pre/post image processing and generate CUDA C++ code for targeting Jetson AGX Xavier

a mixed-precision gemm with quantize and reorder kernel.

Materials for CSE Summer School Hackathon 2024

A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.

semantic vector search demo with gRPC server in Rust

Quantize VietOCR model with Pytorch

Learning to Quantize Deep Networks by Optimizing Quantization Intervals with Task Loss_Pytorch??

An example to quantize MobileNetV2 trained on CIFAR-10 dataset with PyTorch FX graph mode quantization

This sample shows how to convert TensorFlow model to OpenVINO IR model and how to quantize OpenVINO model.

compares different pretrained object classification with per-layer and per-channel quantization using pytorch

A toolbox enables convert, quantize, and inference of models in different formats of FastSAM.

PowerShell automation to download large language models (LLMs) from Git repositories and quantize them with llama.cpp into the GGUF format.

Convert & quantize HuggingFace models using llama.cpp on premises

Quantize LLM using AWQ