Intel Xeon Platinum 8480 - AmusementClub/vs-mlrt GitHub Wiki
Sapphire Rapids XCC, Golden Cove, 56 cores, hyper-threading and amx enabled
Benchmark
vsmlrt v13.1
- openvino 2023.0.0.dev20230119
- linux 5.15
Measured using openvino's benchmark_app:
numactl --cpubind=0 --membind=0 python3 benchmark_app.py -hint none -nthreads 56 -nstreams 1 -m waifu2x/upconv_7_anime_style_art_rgb/scale2.0x_model.onnx -shape "input[1,3,1080,1920]" -ip f32 -op f32 -infer_precision CPU:bf16
OV_CPU
1920x1080 rgbs
Measurements: FPS / Device Memory (MB)
| model | FP32 | BF16 |
|---|---|---|
| dpir color | 0.69 / 2083 | 4.65 / 1476 |
| waifu2x upconv7 | 2.31 / 3438 | 5.52 / 3428 |
| cugan | 1.30 / 6721 | 2.60 / 3616 |
| realesrgan | 2.41 / 1957 | 11.34 / 1211 |