Popular GitHub Repositories for Balancer

Stateful load balancer custom-tailored for llama.cpp ??

The High Performance Proxy/Load Balancer

Scaleguard is a high-performance load balancer and reverse proxy designed to efficiently distribute traffic across multiple servers and ensure seamless service availability.

Gateway and load balancer to your LLM inference endpoints

Practical use of Azure API Management's AI Gateway to manage Azure OpenAI operations.

?? An intelligent load balancer with smart scheduling that unifies diverse LLMs.

The repository with source code which can be used to compare performance of different implementations of the NEAT algorithm

A system-level proxy server in Go, featuring load balancing and syscall-driven I/O to mimic NGINX functionality.

一个开源的、容器化的系统，利用陷阱、蜜罐和智能分析来阻止AI爬虫。

Yarp usage example

A web load balancer built for modern applications

Cartpole Balancer

CloudApp - A Full Stack application with Next.js 14 Frontend (App shell and Micro frontends), Java and Python microservices, Kafka based Chat, Nginx load balancer and reverse proxy, OpenStreetMap, Local Ollama LLM AI and Jira integrations. MongoDB and Postgres database foundation.

The Text Classification using MLOps project delivers a production-ready MLOps pipeline with MLflow for experiment tracking, DVC for data versioning on Amazon S3, and CI/CD automation via GitHub Actions. It features AWS Auto Scaling Groups, Load Balancers, and Launch Templates for scalable and resilient deployments.

AI Movie Recommendation System supporting 1M users