Popular GitHub Repositories for Gateway Api Inference Extension

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Examples and guides for using the OpenAI API

? Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

A high-throughput and memory-efficient inference and serving engine for LLMs

A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.

Port of OpenAI's Whisper model in C/C++

? The Cloud-Native API Gateway and AI Gateway.

Making large AI models cheaper, faster and more accessible

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

Opiniated RAG for integrating GenAI in your apps ? Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: PGVector, Faiss. Any Files. Anyway you want.

A generative speech model for daily dialogue.

Enhancing code comprehension with AI-driven explanations and a secure code snippet repository.

Low-code platform for building business applications. Connect to databases, cloud storages, GraphQL, API endpoints, Airtable, Google sheets, OpenAI, etc and build apps using drag and drop application builder. Built using JavaScript/TypeScript. ?

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

Agno is a lightweight library for building Multimodal Agents. It exposes LLMs as a unified API and gives them superpowers like memory, knowledge, tools and reasoning.

Free ChatGPT&DeepSeek API Key，免费ChatGPT&DeepSeek API。免费接入DeepSeek API和GPT4 API，支持 gpt | deepseek | claude | gemini | grok 等排名靠前的常用大模型。

Integrate the DeepSeek API into popular softwares