Popular GitHub Repositories for Torchscript

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

Python library for analysing faces using PyTorch

Russian text normalization pipeline for speech-to-text and other applications based on tagging s2s networks

PyTorch at the Edge: Deploying Over 964 TIMM Models on Android with TorchScript and Flutter.

Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> ONNX -> TensorRT, Inference pipelines (TensorRT, Triton server - multi-format). Supported model format for Triton inference: TensorRT engine, Torchscript, ONNX

Deploy Swin Transformer using TorchServe

Yet another ssd, with its runtime stack for libtorch, onnx and specialized accelerators.

convert a pytorch model to a model for edge device

Comparing PyTorch, JIT and ONNX for inference with Transformers

Simple HTTP serving for PyTorch ?

An AlphaZero engine for Saiblo Connect4, featuring a pure Python implementation of key KataGo techniques. (中文版简要报告即将推出,敬请期待.)

Classification wrappers for 4 Deep Learning Embedded Runtimes for Music Information Retrieval, plus utilities to convert a TensorFlow Model

Here are Jupyter Notebooks that demonstrate pruning and quantization of the Fashion-MNIST Classification model in Pytorch. Also, using Torchscript, one can easily deploy these models on a C++ platform.

This repository contains scripts to export T5 model to torchscript or onnx.

PyTorch -> ONNX （TorchScript）

Continuously checks torch.onnx op support status

TorchServe handler for inference on TorchScript Model using Pybind11 wrapper which wraps TorchLib's C++ API

本科毕业设计: Torchscript-LLVM编译器

A minimal implementation of a Transformer-based Language Model (LLM) designed for learning and experimentation.

Contains solutoins for assignments and learning notes from Extensive Machine Learning Operations course of The School of AI