Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/CenterFace/RetinaFace/Classify/Unet. use darknet/libtorch/pytorch/mxnet to onnx to tensorrt

Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time inference.

Ray Saturday Dec 2022 edition

MLOps project that recommends movies to watch implementing Data Engineering and MLOps best practices.

[WIP] Advanced workshop covering ML Batch serving on Azure

This repository provides sample codes, which enable you to learn how to use auto-ml image classification, or object detection under Azure ML(AML) environment.

We perform batch inference on lead scoring task using Pyspark.

LightGBM Inference on Datafusion

Serve pytorch inference requests using batching with redis for faster performance.

Support batch inference of Grounding DINO. "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

Torchfusion is a very opinionated torch inference on datafusion.