Popular GitHub Repositories for Loadtest

Basic tool (based on Locust.io) to perform load test of Rasa based chatbot via REST API.

Basic LLM wrapper with 3 consumers: CLI, Flask, and load/scaling test. Works with HuggingFace models like Llama and TinyLlama (and others).