Boostcamp-AI-Tech-Product-Serving

A high-throughput and memory-efficient inference and serving engine for LLMs

Learn how to design, develop, deploy and iterate on production-grade ML applications.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Label Studio is a multi-type data labeling and annotation tool with standardized output format

?? Build multimodal AI applications with cloud-native stack

SGLang is a fast serving framework for large language models and vision language models.

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

Turns Data and AI algorithms into production-ready web applications in no time.