Optimizing-LLM-Inference-using-NVIDIA-Dynamo-and-TorchDynamo

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Gin is a HTTP web framework written in Go (Golang). It features a Martini-like API with much better performance -- up to 40 times faster. If you need smashing performance, get yourself some Gin.

List of Computer Science courses with video lectures.

A curated list of software and architecture related design patterns.

Making large AI models cheaper, faster and more accessible

?? Turn any webpage into a desktop app with Rust. ?? 利用 Rust 轻松构建轻量级多端桌面应用

Learn and understand Docker&Container technologies, with real DevOps practice!

Pulumi - Infrastructure as Code in any programming language ?

ncnn is a high-performance neural network inference framework optimized for the mobile platform

AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.