Benchmarks 2024 11 21 TVM GCC O3 spike_rv32_min - tum-ei-eda/muriscv-nn GitHub Wiki
Setup
Simulator
- Spike (
riscv-isa-sim) (ISS, CPI=1)- Spike :
0bc176b3fca43560b9e8586cdbc41cfde073e17a - Spike PK :
7e9b671c0415dfd7b562ac934feb9380075d4aa2
- Spike :
Toolchains
- RISC-V GCC:
- Scalar:
riscv32-unknown-elf-gcc (gc891d8dc23e) 13.2.0 - Vector:
riscv32-unknown-elf-gcc (gc891d8dc23e) 13.2.0 - Packed: Self compiled using patches found in https://github.com/riscv-collab/riscv-gcc/pull/258 and https://github.com/riscvarchive/riscv-binutils-gdb/pull/257
- Scalar:
Models
-
MLPerfTiny Benchmark
-
TODO: others!
Frameworks
-
MLonMCU :
develop -
TVM :
Nightly Pre-Build
Miscellaneous
- Used
-Osflag for compilation. - Benchmarks generated using MLonMCU deployment tool with minimal efforts.
- Memory metrics are reported in Bytes
Results (Framework: tvm, Backend: tvmaot, Toolchain: gcc, Flags: -O3, Target: spike_rv32_min )
Audio Wake Words (aww)
| Cycles (Speedup) | Total ROM (rel.) | Total RAM (rel.) | VLEN | Layout | Kernels | Mode | Arch | Unroll | Auto-Vectorization |
|---|---|---|---|---|---|---|---|---|---|
14198814 ( 1.1x ) |
169392 ( 1.282 ) |
59524 ( 3.097 ) |
0 | NCHW | TVM | Fallback | RV32IM | 0 | - |
21367144 ( 0.8x ) |
135956 ( 1.029 ) |
59524 ( 3.097 ) |
0 | NHWC | TVM | Fallback | RV32IM | 0 | - |
14218670 ( 1.1x ) |
165024 ( 1.249 ) |
59524 ( 3.097 ) |
128 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
14218670 ( 1.1x ) |
165024 ( 1.249 ) |
59524 ( 3.097 ) |
256 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
14218670 ( 1.1x ) |
165024 ( 1.249 ) |
59524 ( 3.097 ) |
512 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
14218670 ( 1.1x ) |
165024 ( 1.249 ) |
59524 ( 3.097 ) |
1024 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
14218670 ( 1.1x ) |
165024 ( 1.249 ) |
59524 ( 3.097 ) |
2048 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
14218670 ( 1.1x ) |
165024 ( 1.249 ) |
59524 ( 3.097 ) |
4096 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
21291543 ( 0.8x ) |
136064 ( 1.03 ) |
59524 ( 3.097 ) |
128 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
21291543 ( 0.8x ) |
136064 ( 1.03 ) |
59524 ( 3.097 ) |
256 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
21291543 ( 0.8x ) |
136064 ( 1.03 ) |
59524 ( 3.097 ) |
512 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
21291543 ( 0.8x ) |
136064 ( 1.03 ) |
59524 ( 3.097 ) |
1024 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
21291543 ( 0.8x ) |
136064 ( 1.03 ) |
59524 ( 3.097 ) |
2048 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
21291543 ( 0.8x ) |
136064 ( 1.03 ) |
59524 ( 3.097 ) |
4096 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
16190019 ( Base ) |
132144 ( Base ) |
19220 ( Base ) |
0 | NHWC | muRISCV-NN | Scalar | RV32IM | 0 | - |
15536019 ( 1.0x ) |
127856 ( 0.968 ) |
23684 ( 1.232 ) |
0 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM | 0 | - |
16190023 ( 1.0x ) |
132140 ( 1.0 ) |
19220 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
16190022 ( 1.0x ) |
132136 ( 1.0 ) |
19220 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
16190023 ( 1.0x ) |
132140 ( 1.0 ) |
19220 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
16190023 ( 1.0x ) |
132140 ( 1.0 ) |
19220 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
16190022 ( 1.0x ) |
132136 ( 1.0 ) |
19220 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
16190023 ( 1.0x ) |
132140 ( 1.0 ) |
19220 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
8457692 ( 1.9x ) |
134700 ( 1.019 ) |
23684 ( 1.232 ) |
128 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
6564346 ( 2.5x ) |
134700 ( 1.019 ) |
23684 ( 1.232 ) |
256 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
5401652 ( 3.0x ) |
134700 ( 1.019 ) |
23684 ( 1.232 ) |
512 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
5364057 ( 3.0x ) |
134688 ( 1.019 ) |
23684 ( 1.232 ) |
1024 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
5367447 ( 3.0x ) |
134692 ( 1.019 ) |
23684 ( 1.232 ) |
2048 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
5370835 ( 3.0x ) |
134688 ( 1.019 ) |
23684 ( 1.232 ) |
4096 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
15536024 ( 1.0x ) |
127856 ( 0.968 ) |
23684 ( 1.232 ) |
128 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
15536024 ( 1.0x ) |
127856 ( 0.968 ) |
23684 ( 1.232 ) |
256 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
15536021 ( 1.0x ) |
127844 ( 0.967 ) |
23684 ( 1.232 ) |
512 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
15536021 ( 1.0x ) |
127844 ( 0.967 ) |
23684 ( 1.232 ) |
1024 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
15536021 ( 1.0x ) |
127844 ( 0.967 ) |
23684 ( 1.232 ) |
2048 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
15536023 ( 1.0x ) |
127852 ( 0.968 ) |
23684 ( 1.232 ) |
4096 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
Image Classification (resnet)
| Cycles (Speedup) | Total ROM (rel.) | Total RAM (rel.) | VLEN | Layout | Kernels | Mode | Arch | Unroll | Auto-Vectorization |
|---|---|---|---|---|---|---|---|---|---|
57402601 ( 1.0x ) |
268784 ( 1.545 ) |
108436 ( 1.953 ) |
0 | NCHW | TVM | Fallback | RV32IM | 0 | - |
82399340 ( 0.7x ) |
244108 ( 1.404 ) |
108436 ( 1.953 ) |
0 | NHWC | TVM | Fallback | RV32IM | 0 | - |
57383701 ( 1.0x ) |
266836 ( 1.534 ) |
108436 ( 1.953 ) |
128 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
57383701 ( 1.0x ) |
266836 ( 1.534 ) |
108436 ( 1.953 ) |
256 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
57383701 ( 1.0x ) |
266836 ( 1.534 ) |
108436 ( 1.953 ) |
512 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
57383701 ( 1.0x ) |
266836 ( 1.534 ) |
108436 ( 1.953 ) |
1024 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
57383701 ( 1.0x ) |
266836 ( 1.534 ) |
108436 ( 1.953 ) |
2048 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
57383701 ( 1.0x ) |
266836 ( 1.534 ) |
108436 ( 1.953 ) |
4096 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
82425544 ( 0.7x ) |
244920 ( 1.408 ) |
108436 ( 1.953 ) |
128 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
82425544 ( 0.7x ) |
244920 ( 1.408 ) |
108436 ( 1.953 ) |
256 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
82425544 ( 0.7x ) |
244920 ( 1.408 ) |
108436 ( 1.953 ) |
512 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
82425544 ( 0.7x ) |
244920 ( 1.408 ) |
108436 ( 1.953 ) |
1024 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
82425544 ( 0.7x ) |
244920 ( 1.408 ) |
108436 ( 1.953 ) |
2048 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
82425544 ( 0.7x ) |
244920 ( 1.408 ) |
108436 ( 1.953 ) |
4096 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
54541475 ( Base ) |
173916 ( Base ) |
55524 ( Base ) |
0 | NHWC | muRISCV-NN | Scalar | RV32IM | 0 | - |
72587442 ( 0.8x ) |
172912 ( 0.994 ) |
55524 ( 1.0 ) |
0 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM | 0 | - |
54660130 ( 1.0x ) |
173916 ( 1.0 ) |
55524 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
54660127 ( 1.0x ) |
173904 ( 1.0 ) |
55524 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
54660130 ( 1.0x ) |
173916 ( 1.0 ) |
55524 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
54660126 ( 1.0x ) |
173900 ( 1.0 ) |
55524 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
54660130 ( 1.0x ) |
173916 ( 1.0 ) |
55524 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
54660129 ( 1.0x ) |
173912 ( 1.0 ) |
55524 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
27870986 ( 2.0x ) |
181892 ( 1.046 ) |
55524 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
17603680 ( 3.1x ) |
181900 ( 1.046 ) |
55524 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
12988170 ( 4.2x ) |
181900 ( 1.046 ) |
55524 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
10736361 ( 5.1x ) |
181896 ( 1.046 ) |
55524 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
8769048 ( 6.2x ) |
181904 ( 1.046 ) |
55524 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
8235085 ( 6.6x ) |
181904 ( 1.046 ) |
55524 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
72706098 ( 0.8x ) |
172916 ( 0.994 ) |
55524 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
72706101 ( 0.8x ) |
172928 ( 0.994 ) |
55524 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
72706097 ( 0.8x ) |
172912 ( 0.994 ) |
55524 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
72706101 ( 0.8x ) |
172928 ( 0.994 ) |
55524 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
72706097 ( 0.8x ) |
172912 ( 0.994 ) |
55524 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
72706096 ( 0.8x ) |
172908 ( 0.994 ) |
55524 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
Anomaly Detection (toycar)
| Cycles (Speedup) | Total ROM (rel.) | Total RAM (rel.) | VLEN | Layout | Kernels | Mode | Arch | Unroll | Auto-Vectorization |
|---|---|---|---|---|---|---|---|---|---|
1643358 ( 1.0x ) |
613196 ( 1.8 ) |
5548 ( 1.168 ) |
0 | NCHW | TVM | Fallback | RV32IM | 0 | - |
1643358 ( 1.0x ) |
613196 ( 1.8 ) |
5548 ( 1.168 ) |
0 | NHWC | TVM | Fallback | RV32IM | 0 | - |
1643360 ( 1.0x ) |
613312 ( 1.8 ) |
5548 ( 1.168 ) |
128 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1643360 ( 1.0x ) |
613312 ( 1.8 ) |
5548 ( 1.168 ) |
256 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1643360 ( 1.0x ) |
613312 ( 1.8 ) |
5548 ( 1.168 ) |
512 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1643360 ( 1.0x ) |
613312 ( 1.8 ) |
5548 ( 1.168 ) |
1024 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1643360 ( 1.0x ) |
613312 ( 1.8 ) |
5548 ( 1.168 ) |
2048 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1643360 ( 1.0x ) |
613312 ( 1.8 ) |
5548 ( 1.168 ) |
4096 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1643360 ( 1.0x ) |
613312 ( 1.8 ) |
5548 ( 1.168 ) |
128 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1643360 ( 1.0x ) |
613312 ( 1.8 ) |
5548 ( 1.168 ) |
256 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1643360 ( 1.0x ) |
613312 ( 1.8 ) |
5548 ( 1.168 ) |
512 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1643360 ( 1.0x ) |
613312 ( 1.8 ) |
5548 ( 1.168 ) |
1024 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1643360 ( 1.0x ) |
613312 ( 1.8 ) |
5548 ( 1.168 ) |
2048 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1643360 ( 1.0x ) |
613312 ( 1.8 ) |
5548 ( 1.168 ) |
4096 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1680491 ( Base ) |
340676 ( Base ) |
4748 ( Base ) |
0 | NHWC | muRISCV-NN | Scalar | RV32IM | 0 | - |
1680491 ( 1.0x ) |
340676 ( 1.0 ) |
4748 ( 1.0 ) |
0 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM | 0 | - |
1679544 ( 1.0x ) |
340844 ( 1.0 ) |
4748 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
1679544 ( 1.0x ) |
340844 ( 1.0 ) |
4748 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
1679544 ( 1.0x ) |
340844 ( 1.0 ) |
4748 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
1679544 ( 1.0x ) |
340844 ( 1.0 ) |
4748 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
1679544 ( 1.0x ) |
340844 ( 1.0 ) |
4748 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
1679544 ( 1.0x ) |
340844 ( 1.0 ) |
4748 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
896519 ( 1.9x ) |
343632 ( 1.009 ) |
4748 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
668799 ( 2.5x ) |
343632 ( 1.009 ) |
4748 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
554939 ( 3.0x ) |
343632 ( 1.009 ) |
4748 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
498525 ( 3.4x ) |
343632 ( 1.009 ) |
4748 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
494835 ( 3.4x ) |
343632 ( 1.009 ) |
4748 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
494620 ( 3.4x ) |
343632 ( 1.009 ) |
4748 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
1679544 ( 1.0x ) |
340844 ( 1.0 ) |
4748 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
1679544 ( 1.0x ) |
340844 ( 1.0 ) |
4748 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
1679544 ( 1.0x ) |
340844 ( 1.0 ) |
4748 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
1679544 ( 1.0x ) |
340844 ( 1.0 ) |
4748 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
1679544 ( 1.0x ) |
340844 ( 1.0 ) |
4748 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
1679544 ( 1.0x ) |
340844 ( 1.0 ) |
4748 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
Visual Wake Words (vww)
| Cycles (Speedup) | Total ROM (rel.) | Total RAM (rel.) | VLEN | Layout | Kernels | Mode | Arch | Unroll | Auto-Vectorization |
|---|---|---|---|---|---|---|---|---|---|
41779597 ( 1.1x ) |
653748 ( 1.781 ) |
181032 ( 2.113 ) |
0 | NCHW | TVM | Fallback | RV32IM | 0 | - |
60699273 ( 0.8x ) |
566344 ( 1.543 ) |
181032 ( 2.113 ) |
0 | NHWC | TVM | Fallback | RV32IM | 0 | - |
41695560 ( 1.1x ) |
634768 ( 1.729 ) |
181032 ( 2.113 ) |
128 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
41695560 ( 1.1x ) |
634768 ( 1.729 ) |
181032 ( 2.113 ) |
256 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
41695560 ( 1.1x ) |
634768 ( 1.729 ) |
181032 ( 2.113 ) |
512 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
41695560 ( 1.1x ) |
634768 ( 1.729 ) |
181032 ( 2.113 ) |
1024 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
41695560 ( 1.1x ) |
634768 ( 1.729 ) |
181032 ( 2.113 ) |
2048 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
41695560 ( 1.1x ) |
634768 ( 1.729 ) |
181032 ( 2.113 ) |
4096 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
60391213 ( 0.8x ) |
568244 ( 1.548 ) |
181032 ( 2.113 ) |
128 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
60391213 ( 0.8x ) |
568244 ( 1.548 ) |
181032 ( 2.113 ) |
256 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
60391213 ( 0.8x ) |
568244 ( 1.548 ) |
181032 ( 2.113 ) |
512 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
60391213 ( 0.8x ) |
568244 ( 1.548 ) |
181032 ( 2.113 ) |
1024 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
60391213 ( 0.8x ) |
568244 ( 1.548 ) |
181032 ( 2.113 ) |
2048 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
60391213 ( 0.8x ) |
568244 ( 1.548 ) |
181032 ( 2.113 ) |
4096 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
46457649 ( Base ) |
367104 ( Base ) |
85656 ( Base ) |
0 | NHWC | muRISCV-NN | Scalar | RV32IM | 0 | - |
46026182 ( 1.0x ) |
363032 ( 0.989 ) |
85656 ( 1.0 ) |
0 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM | 0 | - |
46457653 ( 1.0x ) |
367100 ( 1.0 ) |
85656 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
46457655 ( 1.0x ) |
367108 ( 1.0 ) |
85656 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
46457658 ( 1.0x ) |
367120 ( 1.0 ) |
85656 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
46457654 ( 1.0x ) |
367104 ( 1.0 ) |
85656 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
46457653 ( 1.0x ) |
367100 ( 1.0 ) |
85656 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
46457657 ( 1.0x ) |
367116 ( 1.0 ) |
85656 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
23379450 ( 2.0x ) |
369868 ( 1.008 ) |
85656 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
17463073 ( 2.7x ) |
369880 ( 1.008 ) |
85656 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
15218759 ( 3.1x ) |
369864 ( 1.008 ) |
85656 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
14190780 ( 3.3x ) |
369872 ( 1.008 ) |
85656 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
14108387 ( 3.3x ) |
369864 ( 1.008 ) |
85656 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
14111777 ( 3.3x ) |
369868 ( 1.008 ) |
85656 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
46026185 ( 1.0x ) |
363024 ( 0.989 ) |
85656 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
46026185 ( 1.0x ) |
363024 ( 0.989 ) |
85656 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
46026185 ( 1.0x ) |
363024 ( 0.989 ) |
85656 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
46026182 ( 1.0x ) |
363012 ( 0.989 ) |
85656 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
46026184 ( 1.0x ) |
363020 ( 0.989 ) |
85656 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
46026182 ( 1.0x ) |
363012 ( 0.989 ) |
85656 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
Original data
Click here to download the raw files for this benchmark.