Popular GitHub Repositories for Silicon

Create and run high-performance macOS and Linux VMs on Apple Silicon, with built-in support for AI agents.

Run Stable Diffusion on Mac natively

On-device Speech Recognition for Apple Silicon

A course of learning LLM inference serving on Apple Silicon for systems engineers.

Highly cited and useful papers related to machine learning, deep learning, AI, game theory, reinforcement learning

A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple Silicon.

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

A MLX port of FLUX based on the Huggingface Diffusers implementation.

SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution

Run LLaMA (and Stanford-Alpaca) inference on Apple Silicon GPUs.

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.

Super simple MLX (apple silicon) CLIP based photo similarity web app

Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.

Finetune llama2-70b and codellama on MacBook Air without quantization

Open source machine learning accelerators

Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.

TensorFlow Metal Backend on Apple Silicon Experiments (just for fun)

SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.

Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon

Run Stable Diffusion using Core ML on iOS within your Expo & React Native App