Popular GitHub Repositories for Commodity Hardware

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Intel® Nervana™ reference deep learning framework committed to best performance on all hardware

? Accelerate inference and training of ? Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

A Curated list of IoT Security Resources

Massively parallel rigidbody physics simulation on accelerator hardware.

Any model. Any hardware. Zero compromise. Built with @ziglang / @openxla / MLIR / @bazelbuild

Open source neural network chess engine with GPU acceleration and broad hardware support.

Highly cited and useful papers related to machine learning, deep learning, AI, game theory, reinforcement learning

Self-hosted, local only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor.

2-2000x faster ML algos, 50% less memory usage, works on all hardware - new and old.

? Monitor deep learning model training and hardware usage from your mobile phone ?

This is originally a collection of papers on neural network accelerators. Now it's more like my selection of research on deep learning and computer architecture.

Hardware for SUSI AI https://susi.ai

[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

Brevitas: neural network quantization in PyTorch

Community maintained hardware plugin for vLLM on Ascend

Stable Diffusion and LLMs offline on your own hardware

Next-gen AI+IoT framework for T2/T3/T5AI/ESP32/and more – Fast IoT and AI Agent hardware integration

Pure python implementation of SNN