Triton-TensorRT-Inference-CRAFT-pytorch

Public

Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> ONNX -> TensorRT, Inference pipelines (TensorRT, Triton server - multi-format). Supported model format for Triton inference: TensorRT engine, Torchscript, ONNX

inference inference-engine inference-server nvidia-docker onnx onnx-torch pytorch tensorrt tensorrt-conversion text-detection

Creat：2021-07-13T22:02:24

Update：2024-11-14T15:35:53

Stars

Stars Increase

Related projects

NextChat

Gin

framework

Gin is a HTTP web framework written in Go (Golang). It features a Martini-like API with much better performance -- up to 40 times faster. If you need smashing performance, get yourself some Gin.

83396

4个月前

+10today

Gpt4all

ai-chat

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

73922

4个月前

+11today

Imgui

api

Dear ImGui: Bloat-free Graphical User interface for C++ with minimal dependencies

67261

4个月前

+34today

Caddy

acme

Fast and extensible multi-platform HTTP/1-2-3 web server with automatic HTTPS

65889

4个月前

+21today

Nuxt

csr

The Intuitive Vue Framework.

57796

4个月前

+14today

Vllm

Hot

amd

A high-throughput and memory-efficient inference and serving engine for LLMs

53684

1年前

+92today

Meilisearch

A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.

52551

4个月前

+6today

Gitea

bitbucket

Git with a cup of tea! Painless self-hosted all-in-one software development service, including Git hosting, code review, team collaboration, package registry and CI/CD

49818

4个月前

+21today