Benchmarks 2024 11 21 TVM LLVM Os spike_rv32_min - tum-ei-eda/muriscv-nn GitHub Wiki
Setup
Simulator
- Spike (
riscv-isa-sim) (ISS, CPI=1)- Spike :
0bc176b3fca43560b9e8586cdbc41cfde073e17a - Spike PK :
7e9b671c0415dfd7b562ac934feb9380075d4aa2
- Spike :
Toolchains
-
RISC-V GCC:
- Scalar:
riscv32-unknown-elf-gcc (gc891d8dc23e) 13.2.0 - Vector:
riscv32-unknown-elf-gcc (gc891d8dc23e) 13.2.0 - Packed: Self compiled using patches found in https://github.com/riscv-collab/riscv-gcc/pull/258 and https://github.com/riscvarchive/riscv-binutils-gdb/pull/257
- Scalar:
-
LLVM/Clang:
clang version 18.1.8 (https://github.com/llvm/llvm-project.git 3b5b5c1ec4a3095ab096dd780e84d7ab81f3d7ff)- Linker: lld (TODO)
Models
-
MLPerfTiny Benchmark
-
TODO: others!
Frameworks
-
MLonMCU :
develop -
TVM :
Nightly Pre-Build
Miscellaneous
- Used
-Osflag for compilation. - Benchmarks generated using MLonMCU deployment tool with minimal efforts.
- Memory metrics are reported in Bytes
Results (Framework: tvm, Backend: tvmaot, Toolchain: llvm, Flags: -Os, Target: spike_rv32_min )
Audio Wake Words (aww)
| Cycles (Speedup) | Total ROM (rel.) | Total RAM (rel.) | VLEN | Layout | Kernels | Mode | Arch | Unroll | Auto-Vectorization |
|---|---|---|---|---|---|---|---|---|---|
29341745 ( 0.5x ) |
144844 ( 1.193 ) |
59492 ( 3.098 ) |
0 | NCHW | TVM | Fallback | RV32IM | 0 | - |
24953091 ( 0.6x ) |
135412 ( 1.116 ) |
59492 ( 3.098 ) |
0 | NHWC | TVM | Fallback | RV32IM | 0 | - |
6068444 ( 2.5x ) |
139360 ( 1.148 ) |
59492 ( 3.098 ) |
128 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
6068444 ( 2.5x ) |
139360 ( 1.148 ) |
59492 ( 3.098 ) |
256 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
6068444 ( 2.5x ) |
139360 ( 1.148 ) |
59492 ( 3.098 ) |
512 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
6068444 ( 2.5x ) |
139360 ( 1.148 ) |
59492 ( 3.098 ) |
1024 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
6068444 ( 2.5x ) |
139360 ( 1.148 ) |
59492 ( 3.098 ) |
2048 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
6071833 ( 2.5x ) |
139360 ( 1.148 ) |
59492 ( 3.098 ) |
4096 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
10088187 ( 1.5x ) |
136212 ( 1.122 ) |
59492 ( 3.098 ) |
128 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
8440187 ( 1.8x ) |
136212 ( 1.122 ) |
59492 ( 3.098 ) |
256 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
7616187 ( 2.0x ) |
136212 ( 1.122 ) |
59492 ( 3.098 ) |
512 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
7204187 ( 2.1x ) |
136212 ( 1.122 ) |
59492 ( 3.098 ) |
1024 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
7204187 ( 2.1x ) |
136212 ( 1.122 ) |
59492 ( 3.098 ) |
2048 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
7207576 ( 2.1x ) |
136212 ( 1.122 ) |
59492 ( 3.098 ) |
4096 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
15106643 ( Base ) |
121372 ( Base ) |
19204 ( Base ) |
0 | NHWC | muRISCV-NN | Scalar | RV32IM | 0 | - |
14550152 ( 1.0x ) |
120132 ( 0.99 ) |
23668 ( 1.232 ) |
0 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM | 0 | - |
7281721 ( 2.1x ) |
123820 ( 1.02 ) |
19204 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
6439411 ( 2.3x ) |
123820 ( 1.02 ) |
19204 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
6018355 ( 2.5x ) |
123820 ( 1.02 ) |
19204 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
5807827 ( 2.6x ) |
123820 ( 1.02 ) |
19204 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
5811216 ( 2.6x ) |
123820 ( 1.02 ) |
19204 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
5814605 ( 2.6x ) |
123820 ( 1.02 ) |
19204 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
5122959 ( 2.9x ) |
121848 ( 1.004 ) |
23668 ( 1.232 ) |
128 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
3988941 ( 3.8x ) |
121848 ( 1.004 ) |
23668 ( 1.232 ) |
256 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
3430663 ( 4.4x ) |
121848 ( 1.004 ) |
23668 ( 1.232 ) |
512 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
3389675 ( 4.5x ) |
121848 ( 1.004 ) |
23668 ( 1.232 ) |
1024 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
3393064 ( 4.5x ) |
121848 ( 1.004 ) |
23668 ( 1.232 ) |
2048 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
3396453 ( 4.4x ) |
121848 ( 1.004 ) |
23668 ( 1.232 ) |
4096 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
8152697 ( 1.9x ) |
122408 ( 1.009 ) |
23668 ( 1.232 ) |
128 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
7310387 ( 2.1x ) |
122408 ( 1.009 ) |
23668 ( 1.232 ) |
256 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
6889331 ( 2.2x ) |
122408 ( 1.009 ) |
23668 ( 1.232 ) |
512 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
6678803 ( 2.3x ) |
122408 ( 1.009 ) |
23668 ( 1.232 ) |
1024 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
6682192 ( 2.3x ) |
122408 ( 1.009 ) |
23668 ( 1.232 ) |
2048 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
6685581 ( 2.3x ) |
122408 ( 1.009 ) |
23668 ( 1.232 ) |
4096 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
Image Classification (resnet)
| Cycles (Speedup) | Total ROM (rel.) | Total RAM (rel.) | VLEN | Layout | Kernels | Mode | Arch | Unroll | Auto-Vectorization |
|---|---|---|---|---|---|---|---|---|---|
124480021 ( 0.5x ) |
254924 ( 1.523 ) |
108404 ( 1.953 ) |
0 | NCHW | TVM | Fallback | RV32IM | 0 | - |
101654631 ( 0.6x ) |
241316 ( 1.441 ) |
108404 ( 1.953 ) |
0 | NHWC | TVM | Fallback | RV32IM | 0 | - |
25278294 ( 2.2x ) |
248936 ( 1.487 ) |
108404 ( 1.953 ) |
128 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
25278294 ( 2.2x ) |
248936 ( 1.487 ) |
108404 ( 1.953 ) |
256 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
25278295 ( 2.2x ) |
248940 ( 1.487 ) |
108404 ( 1.953 ) |
512 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
25278295 ( 2.2x ) |
248940 ( 1.487 ) |
108404 ( 1.953 ) |
1024 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
25278294 ( 2.2x ) |
248936 ( 1.487 ) |
108404 ( 1.953 ) |
2048 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
25281683 ( 2.2x ) |
248936 ( 1.487 ) |
108404 ( 1.953 ) |
4096 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
37241479 ( 1.5x ) |
242628 ( 1.449 ) |
108404 ( 1.953 ) |
128 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
28190343 ( 2.0x ) |
242628 ( 1.449 ) |
108404 ( 1.953 ) |
256 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
25925767 ( 2.2x ) |
242628 ( 1.449 ) |
108404 ( 1.953 ) |
512 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
25481607 ( 2.2x ) |
242628 ( 1.449 ) |
108404 ( 1.953 ) |
1024 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
25481607 ( 2.2x ) |
242628 ( 1.449 ) |
108404 ( 1.953 ) |
2048 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
25484996 ( 2.2x ) |
242628 ( 1.449 ) |
108404 ( 1.953 ) |
4096 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
56263273 ( Base ) |
167428 ( Base ) |
55508 ( Base ) |
0 | NHWC | muRISCV-NN | Scalar | RV32IM | 0 | - |
72451554 ( 0.8x ) |
166492 ( 0.994 ) |
55508 ( 1.0 ) |
0 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM | 0 | - |
26484410 ( 2.1x ) |
170624 ( 1.019 ) |
55508 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
18423012 ( 3.1x ) |
170624 ( 1.019 ) |
55508 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
14644316 ( 3.8x ) |
170624 ( 1.019 ) |
55508 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
12922904 ( 4.4x ) |
170624 ( 1.019 ) |
55508 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
12086613 ( 4.7x ) |
170624 ( 1.019 ) |
55508 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
11460242 ( 4.9x ) |
170624 ( 1.019 ) |
55508 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
15265109 ( 3.7x ) |
168912 ( 1.009 ) |
55508 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
9682361 ( 5.8x ) |
168912 ( 1.009 ) |
55508 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
7136747 ( 7.9x ) |
168912 ( 1.009 ) |
55508 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
5894731 ( 9.5x ) |
168912 ( 1.009 ) |
55508 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
4969912 ( 11.3x ) |
168912 ( 1.009 ) |
55508 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
4724237 ( 11.9x ) |
168912 ( 1.009 ) |
55508 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
20235932 ( 2.8x ) |
168948 ( 1.009 ) |
55508 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
14140614 ( 4.0x ) |
168948 ( 1.009 ) |
55508 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
11283518 ( 5.0x ) |
168948 ( 1.009 ) |
55508 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
9981946 ( 5.6x ) |
168948 ( 1.009 ) |
55508 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
9350455 ( 6.0x ) |
168948 ( 1.009 ) |
55508 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
8877684 ( 6.3x ) |
168948 ( 1.009 ) |
55508 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
Anomaly Detection (toycar)
| Cycles (Speedup) | Total ROM (rel.) | Total RAM (rel.) | VLEN | Layout | Kernels | Mode | Arch | Unroll | Auto-Vectorization |
|---|---|---|---|---|---|---|---|---|---|
3203005 ( 0.5x ) |
607644 ( 1.78 ) |
5540 ( 1.169 ) |
0 | NCHW | TVM | Fallback | RV32IM | 0 | - |
3203005 ( 0.5x ) |
607644 ( 1.78 ) |
5540 ( 1.169 ) |
0 | NHWC | TVM | Fallback | RV32IM | 0 | - |
1407035 ( 1.2x ) |
607256 ( 1.779 ) |
5540 ( 1.169 ) |
128 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1407035 ( 1.2x ) |
607256 ( 1.779 ) |
5540 ( 1.169 ) |
256 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1407035 ( 1.2x ) |
607256 ( 1.779 ) |
5540 ( 1.169 ) |
512 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1407035 ( 1.2x ) |
607256 ( 1.779 ) |
5540 ( 1.169 ) |
1024 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1407035 ( 1.2x ) |
607256 ( 1.779 ) |
5540 ( 1.169 ) |
2048 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1407035 ( 1.2x ) |
607256 ( 1.779 ) |
5540 ( 1.169 ) |
4096 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1407035 ( 1.2x ) |
607256 ( 1.779 ) |
5540 ( 1.169 ) |
128 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1407035 ( 1.2x ) |
607256 ( 1.779 ) |
5540 ( 1.169 ) |
256 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1407035 ( 1.2x ) |
607256 ( 1.779 ) |
5540 ( 1.169 ) |
512 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1407035 ( 1.2x ) |
607256 ( 1.779 ) |
5540 ( 1.169 ) |
1024 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1407035 ( 1.2x ) |
607256 ( 1.779 ) |
5540 ( 1.169 ) |
2048 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1407035 ( 1.2x ) |
607256 ( 1.779 ) |
5540 ( 1.169 ) |
4096 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
1719310 ( Base ) |
341380 ( Base ) |
4740 ( Base ) |
0 | NHWC | muRISCV-NN | Scalar | RV32IM | 0 | - |
1719312 ( 1.0x ) |
341388 ( 1.0 ) |
4740 ( 1.0 ) |
0 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM | 0 | - |
621988 ( 2.8x ) |
341704 ( 1.001 ) |
4740 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
508067 ( 3.4x ) |
341700 ( 1.001 ) |
4740 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
451109 ( 3.8x ) |
341708 ( 1.001 ) |
4740 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
422628 ( 4.1x ) |
341704 ( 1.001 ) |
4740 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
408388 ( 4.2x ) |
341704 ( 1.001 ) |
4740 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
406604 ( 4.2x ) |
341704 ( 1.001 ) |
4740 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
617072 ( 2.8x ) |
342796 ( 1.004 ) |
4740 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
500392 ( 3.4x ) |
342796 ( 1.004 ) |
4740 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
442053 ( 3.9x ) |
342800 ( 1.004 ) |
4740 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
413205 ( 4.2x ) |
342792 ( 1.004 ) |
4740 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
409575 ( 4.2x ) |
342796 ( 1.004 ) |
4740 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
407721 ( 4.2x ) |
342804 ( 1.004 ) |
4740 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
621988 ( 2.8x ) |
341704 ( 1.001 ) |
4740 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
508068 ( 3.4x ) |
341704 ( 1.001 ) |
4740 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
451108 ( 3.8x ) |
341704 ( 1.001 ) |
4740 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
422628 ( 4.1x ) |
341704 ( 1.001 ) |
4740 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
408389 ( 4.2x ) |
341708 ( 1.001 ) |
4740 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
406603 ( 4.2x ) |
341700 ( 1.001 ) |
4740 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
Visual Wake Words (vww)
| Cycles (Speedup) | Total ROM (rel.) | Total RAM (rel.) | VLEN | Layout | Kernels | Mode | Arch | Unroll | Auto-Vectorization |
|---|---|---|---|---|---|---|---|---|---|
84532790 ( 0.5x ) |
592472 ( 1.663 ) |
181000 ( 2.113 ) |
0 | NCHW | TVM | Fallback | RV32IM | 0 | - |
72618651 ( 0.6x ) |
560892 ( 1.574 ) |
181000 ( 2.113 ) |
0 | NHWC | TVM | Fallback | RV32IM | 0 | - |
18315346 ( 2.5x ) |
573284 ( 1.609 ) |
181000 ( 2.113 ) |
128 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
18315347 ( 2.5x ) |
573288 ( 1.609 ) |
181000 ( 2.113 ) |
256 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
18315346 ( 2.5x ) |
573284 ( 1.609 ) |
181000 ( 2.113 ) |
512 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
18315348 ( 2.5x ) |
573292 ( 1.609 ) |
181000 ( 2.113 ) |
1024 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
18315346 ( 2.5x ) |
573284 ( 1.609 ) |
181000 ( 2.113 ) |
2048 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
18318735 ( 2.5x ) |
573284 ( 1.609 ) |
181000 ( 2.113 ) |
4096 | NCHW | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
31551467 ( 1.4x ) |
561408 ( 1.576 ) |
181000 ( 2.113 ) |
128 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
26920139 ( 1.7x ) |
561408 ( 1.576 ) |
181000 ( 2.113 ) |
256 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
24723131 ( 1.8x ) |
561408 ( 1.576 ) |
181000 ( 2.113 ) |
512 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
23800594 ( 1.9x ) |
561404 ( 1.576 ) |
181000 ( 2.113 ) |
1024 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
23435375 ( 1.9x ) |
561408 ( 1.576 ) |
181000 ( 2.113 ) |
2048 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
23407475 ( 1.9x ) |
561408 ( 1.576 ) |
181000 ( 2.113 ) |
4096 | NHWC | TVM | Fallback | RV32IM_ZVE64X | 0 | Loop+SLP |
45052338 ( Base ) |
356324 ( Base ) |
85640 ( Base ) |
0 | NHWC | muRISCV-NN | Scalar | RV32IM | 0 | - |
44863887 ( 1.0x ) |
355288 ( 0.997 ) |
85640 ( 1.0 ) |
0 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM | 0 | - |
19436027 ( 2.3x ) |
359248 ( 1.008 ) |
85640 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
16560411 ( 2.7x ) |
359248 ( 1.008 ) |
85640 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
15182619 ( 3.0x ) |
359248 ( 1.008 ) |
85640 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
14678379 ( 3.1x ) |
359248 ( 1.008 ) |
85640 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
14475248 ( 3.1x ) |
359248 ( 1.008 ) |
85640 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
14461201 ( 3.1x ) |
359248 ( 1.008 ) |
85640 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Scalar | RV32IM_ZVE64X | 0 | Loop+SLP |
13483808 ( 3.3x ) |
357480 ( 1.003 ) |
85640 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
10162808 ( 4.4x ) |
357480 ( 1.003 ) |
85640 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
8871380 ( 5.1x ) |
357480 ( 1.003 ) |
85640 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
8367390 ( 5.4x ) |
357480 ( 1.003 ) |
85640 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
8323010 ( 5.4x ) |
357480 ( 1.003 ) |
85640 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
8326398 ( 5.4x ) |
357476 ( 1.003 ) |
85640 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector | RV32IM_ZVE64X | 0 | - |
22310128 ( 2.0x ) |
358040 ( 1.005 ) |
85640 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
19526672 ( 2.3x ) |
358040 ( 1.005 ) |
85640 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
18194959 ( 2.5x ) |
358036 ( 1.005 ) |
85640 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
17690720 ( 2.5x ) |
358040 ( 1.005 ) |
85640 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
17487589 ( 2.6x ) |
358040 ( 1.005 ) |
85640 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
17473542 ( 2.6x ) |
358040 ( 1.005 ) |
85640 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector (Portable) | RV32IM_ZVE64X | 0 | Loop+SLP |
Original data
Click here to download the raw files for this benchmark.