Popular GitHub Repositories for Endpoint

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs

A middleware to provide an openAI compatible endpoint that can call MCP tools

Slips, a free software behavioral Python intrusion prevention system (IDS/IPS) that uses machine learning to detect malicious behaviors in the network traffic. Stratosphere Laboratory, AIC, FEL, CVUT in Prague.

Web EPUB and PDF text to speech document reader. Read documents in realtime with high-quality TTS; or extract audiobooks. Use your own Kokoro TTS API or Open AI API endpoint.

Use LLMs for building real-world apps

showing various ways to serve Keras based stable diffusion

? | RunPod worker of the faster-whisper model for Serverless Endpoint.

The Azure AI proxy service facilitates easy access to Azure AI resources for workshops and hackathons. It offers a Playground-like interface and supports Azure AI SDKs. Access is granted through a time-limited API key and endpoint.

AI - a simple commandline local/remote LLM chat client. Supports any local or remote OpenAI-compatible API endpoint (GPT4o, Gemini, Grok, OpenRouter, Ollama, LM Studio and more), model management, multiple conversations support, automatic topic identification, image generation using Dall-E and stdin piping (sending files to LLM for inspection)

A powerful MCP server that enables Claude to discover and call any API endpoint through semantic search. Intelligently chunks OpenAPI specifications to handle large API documentation, with built-in request execution capabilities. Perfect for integrating private APIs with Claude Desktop.

This project demonstrates how to generate images using Stable Diffusion or FLUX.1 models by hosting ComfyUI on Amazon SageMaker inference endpoint.

Turn any OCR models into online inference API endpoint ? ?

An endpoint server for efficiently serving quantized open-source LLMs for code.

An open-source MCP server for integrating Wazuh security data with LLMs (such as the Claude Desktop App). This service authenticates with the Wazuh RESTful API, retrieves alerts from Elasticsearch indices, transforms events into an MCP-compliant JSON format, and exposes an HTTP endpoint for Claude Desktop to fetch real-time security context.

An example SvelteKit project using sveltekit-modal, with a Python server endpoint written in langchain.

LLMtranslator translates and generates text in multiple languages.

Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.

Integrating Airbyte, Kafka, Airflow and MLflow on Azure Linux VMs within private network to continuously retrain LSTM Attention model with 1-minute stock prices and redeploy it on Azure ML AKS real-time inference endpoint behind serverless Azure API

LoRA fine-tuned Stable Diffusion Deployment