MLPerf Inference v0.7 - AshokBhat/ml GitHub Wiki

Intel CPU Inference - RESNET-50

Intel Xeon Gold 6258R CPU @ 2.70GHz (Cascade Lake, 28-cores)

Config	Software	Server (queries/s)	Offline (samples/s)
1-node-2S-CLX-MXNet-INT8	MXNet	1,798	2,812
1-node-2S-CLX-OpenVINO-INT8	OpenVINO	2,078	2,811
1-node-2S-CLX-TensorFlow-INT8	TensorFlow v2.3.0	1,728	2,714

Intel Xeon Platinum 8380H CPU @ 2.90GHz (Cooper Lake, 28-cores)

Config	Software	Server (queries/s)	Offline (samples/s)
1-node-4S-CPX-OpenVINO-BF16	OpenVINO	1,748	2,376
1-node-4S-CPX-OpenVINO-INT8	OpenVINO	4,246	5,669
1-node-8S-CPX-MXNet-INT8	MXNet	7,847	11,181
1-node-8S-CPX-TensorFlow-BF16	TensorFlow	3,147	5,319
1-node-8S-CPX-TensorFlow-INT8	TensorFlow 2.3	7,516	10,668