Popular GitHub Repositories for Npu Compiler

? Empowering everyone to build reliable and efficient smart contracts.

Open deep learning compiler stack for cpu, gpu and specialized accelerators

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

Tengine is a lite, high performance, modular inference engine for embedded device

cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，标注平台，自动化标注，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式，deepseek训练推理

A retargetable MLIR-based machine learning compiler and runtime toolkit.

Training and serving large-scale neural networks with auto parallelization.

Enabling PyTorch on XLA Devices (e.g. Google TPU)

A list of awesome compiler projects and papers for tensor computation and deep learning.

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem.

Must read research papers and links to tools and datasets that are related to using machine learning for compilers and systems optimisation

High-performance automatic differentiation of LLVM and MLIR.

nGraph has moved to OpenVINO

TypeScript Agentic AI Library specialized for LLM Function Calling enhanced by compiler skills.

BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.

Dataflow compiler for QNN inference on FPGAs

Adlik: Toolkit for Accelerating Deep Learning Inference

Open deep learning compiler stack for Kendryte AI accelerators ?

Machine learning compiler based on MLIR for Sophgo TPU.