Onnx Libraries

10 Components & Libraries

Sortby

Onnx Libraries

Machine learning on FPGAs using HLS

A package for machine learning inference in FPGAs. We create firmware implementations of machine learning algorithms using high level synthesis language (HLS). We translate traditional open-source ma…

A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.

You can run Inference on an edge device like an NVIDIA Jetson, or on cloud computing platforms like AWS, GCP, and Azure. Currently, the stream interface only supports object detection Check out Infer…

InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.

This repository aims to provide convenient, easy deployable and scalable REST API for InsightFace face detection and recognition pipeline using FastAPI for serving and NVIDIA TensorRT for optimized i…

Convert images of formula into LaTeX code based on ONNXRuntime.

If it helps you, please give a little star ⭐ or sponsor a cup of coffee (click the link in Sponsor at the top of the page) NOTE: When installing the package through pip, the model file will be automa…

This project shows how to serve an ONNX-optimized image classification model as a web service with FastAPI, Docker, and Kubernetes.

Configure bucket storage related permissions for the service account: We conducted load-testing varying the number of workers, RAM, nodes, etc. From that experiment, we found out that for our setup, …