Popular GitHub Repositories for Optimum Intel

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

Intel® Nervana™ reference deep learning framework committed to best performance on all hardware

? Accelerate inference and training of ? Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

QualityScaler - image/video AI upscaler app

Reinforcement Learning Coach by Intel AI Lab enables easy experimentation with state of the art Reinforcement Learning algorithms

? Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms?

dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, TPU, and Intel accelerators.

NCNN implementation of Real-ESRGAN. Real-ESRGAN aims at developing Practical Algorithms for General Image Restoration.

Machine learning on FPGAs using HLS

Large-scale LLM inference engine

A pytorch quantization backend for optimum

Contains examples for the Movidius Neural Compute Stick.

Library for specialized dense and sparse matrix operations, and deep learning primitives.

Video Frame Interpolation & Super Resolution using NVIDIA's TensorRT & Tencent's NCNN inference, beautifully crafted and packaged into a single app

Intel? AI Reference Models: contains Intel optimizations for running deep learning workloads on Intel? Xeon? Scalable processors and Intel? Data Center GPUs

Production ready LLM model compression/quantization toolkit with hw accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

This repository is a home to Intel? Deep Learning Streamer (Intel? DL Streamer) Pipeline Framework. Pipeline Framework is a streaming media analytics framework, based on GStreamer* multimedia framework, for creating complex media analytics pipelines.

Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL

Confidential AI deployment with secure enclaves :lock:

? Optimum Intel: Accelerate inference with Intel optimization tools