Popular GitHub Repositories for Container Safety

Tengine is a lite, high performance, modular inference engine for embedded device

A curated list of awesome responsible machine learning resources.

a self-hosted solution for running ai-generated code in secure sandboxes

An open-source data logging library for machine learning models and data pipelines. ? Provides visibility into data quality & model performance over time. ?️ Supports privacy-preserving data collection, ensuring safety & robustness. ?

Containerized versions of hundreds of MCP servers ? ?

Effortlessly run LLM backends, APIs, frontends, and services with one command.

dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, TPU, and Intel accelerators.

A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

IBM Fully Homomorphic Encryption Toolkit For Linux. This toolkit is a Linux based Docker container that demonstrates computing on encrypted data without decrypting it! The toolkit ships with two demos including a fully encrypted Machine Learning inference with a Neural Network and a Privacy-Preserving key-value search.

Secrets of RLHF in Large Language Models Part I: PPO

Corruption and Perturbation Robustness (ICLR 2019)

Chinese safety prompts for evaluating and improving the safety of LLMs. 中文安全prompts，用于评估和提升大模型的安全性。

JMLR: OmniSafe is an infrastructural framework for accelerating SafeRL research.

? LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). ? Extracts signals from prompts & responses, ensuring safety & security. ?? Features include text quality, relevance metrics, & sentiment analysis. ? A comprehensive tool for LLM observability. ?

Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses.

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

Awesome-LLM-Robustness: a curated list of Uncertainty, Reliability and Robustness in Large Language Models

Run the official Stable Diffusion releases in a Docker container with txt2img, img2img, depth2img, pix2pix, upscale4x, and inpaint.

PyBullet CartPole and Quadrotor environments—with CasADi symbolic a priori dynamics—for learning-based control and RL