Popular GitHub Repositories for Tensorrt Engine

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

A high-throughput and memory-efficient inference and serving engine for LLMs

A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

AI's query engine - Platform for building AI that can learn and answer questions over large scale federated data.

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI

Universal LLM Deployment Engine with ML Compilation

Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research

High-performance In-browser LLM Inference Engine

Machine Learning Toolkit for Kubernetes

ChatterBot is a machine learning, conversational dialog engine for creating chat bots

Annotate better with CVAT, the industry-leading data engine for machine learning. Used and trusted by teams at any scale, for data of any scale.

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database?.

? Easy-to-use and powerful NLP and LLM library with ? Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including ?Text Classification, ? Neural Search, ? Question Answering, ?? Information Extraction, ? Document Intelligence, ? Sentiment Analysis etc.

NVIDIA? TensorRT? is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

? All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows