Popular GitHub Repositories for Tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 15+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

JAX implementation of OpenAI's Whisper model for up to 70x speed-up on TPU.

Fast and flexible AutoML with learning guarantees.

Enabling PyTorch on XLA Devices (e.g. Google TPU)

Probabilistic programming with NumPy powered by JAX for autograd and JIT compilation to GPU/TPU/CPU.

Everything we actually know about the Apple Neural Engine (ANE)

dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, TPU, and Intel accelerators.

GPT2 for Multiple Languages, including pretrained models. GPT2 多语言支持, 15亿参数中文预训练模型

Large-scale LLM inference engine

Machine learning compiler based on MLIR for Sophgo TPU.

Real-time portrait segmentation for mobile devices

Class-Balanced Loss Based on Effective Number of Samples. CVPR 2019

Backend.AI is a streamlined, container-based computing cluster platform that hosts popular computing/ML frameworks and diverse programming languages, with pluggable heterogeneous accelerator support including CUDA GPU, ROCm GPU, TPU, IPU and other NPUs.

Everything you want to know about Google Cloud TPU

Neural network-based chess engine capable of natural language commentary

Implementation of a Tensor Processing Unit for embedded systems and the IoT.

Differentiable Fluid Dynamics Package