Popular GitHub Repositories for Load Demand

Curated list of apps and tools that not only use the new ChatGPT API, but also allow users to configure their own API keys, enabling free and on-demand usage of their own quota.

Translate darknet to tensorflow. Load trained weights, retrain/fine-tune using tensorflow, export constant graph def to mobile devices

List of papers, code and experiments using deep learning for time series forecasting

Implementation of BERT that could load official pre-trained models for feature extraction and prediction

This is a project that unifies the management of LLM APIs. It can call multiple backend services through a unified API interface, convert them to the OpenAI format uniformly, and support load balancing. Currently supported backend services include: OpenAI, Anthropic, DeepBricks, OpenRouter, Gemini, Vertex, etc.

Slimmable Networks, AutoSlim, and Beyond, ICLR 2019, and ICCV 2019

Time-Series Work Summary in CS Top Conferences (NIPS, ICML, ICLR, KDD, AAAI, WWW, IJCAI, CIKM, ICDM, ICDE, etc.)

一个高性能的OpenAI格式API多密钥轮询代理服务器，支持负载均衡，使用 Go 语言开发。A high-performance OpenAI-compatible API proxy server with multi-key rotation and load balancing, built with Go.

Stateful load balancer custom-tailored for llama.cpp ??

Forecasting electric power load of Delhi using ARIMA, RNN, LSTM, and GRU models

The High Performance Proxy/Load Balancer

The merlin dataloader lets you rapidly load tabular data for training deep leaning models with TensorFlow, PyTorch or JAX

Learn to serve Stable Diffusion models on cloud infrastructure at scale. This Lightning App shows load-balancing, orchestrating, pre-provisioning, dynamic batching, GPU-inference, micro-services working together via the Lightning Apps framework.

stable diffusion multi-user django server code with multi-GPU load balancing

A shared library of on-demand DeepStream Pipeline Services for Python and C/C++

Save, Load Frozen Graph and Run Inference From Frozen Graph in TensorFlow 1.x and 2.x

A Python library that enables ML teams to share, load, and transform data in a collaborative, flexible, and efficient way :chestnut:

Summary of open source code for deep learning models in the field of traffic prediction

AI-powered inventory management system using LSTM models and transfer learning to forecast product demand, minimize stockouts, and reduce overstock. Designed for easy adaptation to real-world business data.

Python framework for building scalable multi-agent systems with built-in orchestration, LLM integration, and intelligent task processing. Features dynamic scaling, fault tolerance, and advanced load balancing.