ONNX Runtime - AshokBhat/ml GitHub Wiki

About

• Runtime that support inference and training with ONNX format
• Github project
• Backend - cuDNN, ACL, ArmNN, OpenVINO, TensorRT,...

Developers

• Microsoft is primary developer
• NXP has contributed ACL backend

Usage

• Used in Office 365, Visual Studio, and Bing
• Delivering half-trillion inferences every day

Releases

Release	Date	Features
v1.14	February 2023
v1.15	May 2023
v1.16	August 2023
v1.17	November 2023	TBD
v1.18	February 2024	TBD

Sources

• https://cloudblogs.microsoft.com/opensource/tag/onnx/

Resources

• https://www.youtube.com/watch?v=Ij5MoUnLQ0E

See also

• Inference engine
• Triton Inference Server