Benchmarks 2024 06 29 TVM LLVM Os - tum-ei-eda/muriscv-nn GitHub Wiki
Setup
Simulator
- Spike (
riscv-isa-sim) (ISS, CPI=1)
Toolchains
- LLVM/Clang:
- TODO: Version
- Linker: lld (TODO)
- RISC-V GCC for Headers, libc,...
Models
-
MLPerfTiny Benchmark
-
TODO: others!
Package Versions
-
MLonMCU : main
-
TVM : Nightly Pre-Build
-
Spike : 0bc176b3fca43560b9e8586cdbc41cfde073e17a
-
Spike PK : 7e9b671c0415dfd7b562ac934feb9380075d4aa2
Miscellaneous
- Used
-Osflag for compilation. - Benchmarks generated using MLonMCU deployment tool with minimal efforts.
- Memory metrics are reported in Bytes
Results (Framework: tvm, Backend: tvmaot, Toolchain: llvm, Flags: -Os)
Audio Wake Words (aww)
| Cycles (Speedup) | Total ROM (rel.) | Total RAM (rel.) | VLEN | Layout | Kernels | Mode | Arch | Unroll | Auto-Vectorization |
|---|---|---|---|---|---|---|---|---|---|
29352780 ( 0.5x ) |
110144 ( 1.213 ) |
59508 ( 3.097 ) |
128 | NCHW | TVM | Fallback | RV32GC | 0 | - |
24906064 ( 0.6x ) |
103490 ( 1.14 ) |
59508 ( 3.097 ) |
128 | NHWC | TVM | Fallback | RV32GC | 0 | - |
13101388 ( 1.2x ) |
102978 ( 1.134 ) |
51336 ( 2.672 ) |
128 | NCHW | TVM | Autotuned | RV32GC | 0 | - |
24901440 ( 0.6x ) |
103618 ( 1.141 ) |
59508 ( 3.097 ) |
128 | NHWC | TVM | Autotuned | RV32GC | 0 | - |
6062819 ( 2.5x ) |
106868 ( 1.177 ) |
59508 ( 3.097 ) |
128 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
6062819 ( 2.5x ) |
106868 ( 1.177 ) |
59508 ( 3.097 ) |
256 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
6062819 ( 2.5x ) |
106868 ( 1.177 ) |
59508 ( 3.097 ) |
512 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
6062819 ( 2.5x ) |
106868 ( 1.177 ) |
59508 ( 3.097 ) |
1024 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
6062819 ( 2.5x ) |
106868 ( 1.177 ) |
59508 ( 3.097 ) |
2048 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
6062819 ( 2.5x ) |
106868 ( 1.177 ) |
59508 ( 3.097 ) |
4096 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
10045509 ( 1.5x ) |
104080 ( 1.146 ) |
59508 ( 3.097 ) |
128 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
8397509 ( 1.8x ) |
104080 ( 1.146 ) |
59508 ( 3.097 ) |
256 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
7573509 ( 2.0x ) |
104080 ( 1.146 ) |
59508 ( 3.097 ) |
512 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
7161509 ( 2.1x ) |
104080 ( 1.146 ) |
59508 ( 3.097 ) |
1024 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
7161509 ( 2.1x ) |
104080 ( 1.146 ) |
59508 ( 3.097 ) |
2048 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
7161509 ( 2.1x ) |
104080 ( 1.146 ) |
59508 ( 3.097 ) |
4096 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
4369986 ( 3.5x ) |
105352 ( 1.16 ) |
51336 ( 2.672 ) |
128 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
3500718 ( 4.3x ) |
105352 ( 1.16 ) |
51336 ( 2.672 ) |
256 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
3129308 ( 4.8x ) |
105352 ( 1.16 ) |
51336 ( 2.672 ) |
512 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
2943603 ( 5.2x ) |
105352 ( 1.16 ) |
51336 ( 2.672 ) |
1024 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
2946992 ( 5.1x ) |
105352 ( 1.16 ) |
51336 ( 2.672 ) |
2048 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
2950381 ( 5.1x ) |
105352 ( 1.16 ) |
51336 ( 2.672 ) |
4096 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
10043679 ( 1.5x ) |
104920 ( 1.155 ) |
59508 ( 3.097 ) |
128 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
8395211 ( 1.8x ) |
104920 ( 1.155 ) |
59508 ( 3.097 ) |
256 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
7571001 ( 2.0x ) |
104920 ( 1.155 ) |
59508 ( 3.097 ) |
512 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
7158896 ( 2.1x ) |
104920 ( 1.155 ) |
59508 ( 3.097 ) |
1024 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
7162285 ( 2.1x ) |
104920 ( 1.155 ) |
59508 ( 3.097 ) |
2048 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
7165674 ( 2.1x ) |
104920 ( 1.155 ) |
59508 ( 3.097 ) |
4096 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
15175760 ( Base ) |
90814 ( Base ) |
19212 ( Base ) |
128 | NHWC | muRISCV-NN | Scalar | RV32GC | 0 | - |
7279052 ( 2.1x ) |
93914 ( 1.034 ) |
19284 ( 1.004 ) |
128 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
6436745 ( 2.4x ) |
93914 ( 1.034 ) |
19284 ( 1.004 ) |
256 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
6015689 ( 2.5x ) |
93914 ( 1.034 ) |
19284 ( 1.004 ) |
512 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
5805161 ( 2.6x ) |
93914 ( 1.034 ) |
19284 ( 1.004 ) |
1024 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
5808550 ( 2.6x ) |
93914 ( 1.034 ) |
19284 ( 1.004 ) |
2048 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
5811939 ( 2.6x ) |
93914 ( 1.034 ) |
19284 ( 1.004 ) |
4096 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
5120813 ( 3.0x ) |
91040 ( 1.002 ) |
23676 ( 1.232 ) |
128 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
3986795 ( 3.8x ) |
91040 ( 1.002 ) |
23676 ( 1.232 ) |
256 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
3428517 ( 4.4x ) |
91040 ( 1.002 ) |
23676 ( 1.232 ) |
512 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
3387529 ( 4.5x ) |
91040 ( 1.002 ) |
23676 ( 1.232 ) |
1024 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
3390918 ( 4.5x ) |
91040 ( 1.002 ) |
23676 ( 1.232 ) |
2048 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
3394307 ( 4.5x ) |
91040 ( 1.002 ) |
23676 ( 1.232 ) |
4096 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
Image Classification (resnet)
| Cycles (Speedup) | Total ROM (rel.) | Total RAM (rel.) | VLEN | Layout | Kernels | Mode | Arch | Unroll | Auto-Vectorization |
|---|---|---|---|---|---|---|---|---|---|
124501902 ( 0.5x ) |
219348 ( 1.586 ) |
108420 ( 1.953 ) |
128 | NCHW | TVM | Fallback | RV32GC | 0 | - |
101622291 ( 0.6x ) |
209790 ( 1.517 ) |
108420 ( 1.953 ) |
128 | NHWC | TVM | Fallback | RV32GC | 0 | - |
51833230 ( 1.1x ) |
213566 ( 1.544 ) |
92236 ( 1.661 ) |
128 | NCHW | TVM | Autotuned | RV32GC | 0 | - |
101623451 ( 0.6x ) |
209890 ( 1.518 ) |
108420 ( 1.953 ) |
128 | NHWC | TVM | Autotuned | RV32GC | 0 | - |
25170934 ( 2.2x ) |
215538 ( 1.559 ) |
108420 ( 1.953 ) |
128 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
25170933 ( 2.2x ) |
215532 ( 1.559 ) |
108420 ( 1.953 ) |
256 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
25170934 ( 2.2x ) |
215538 ( 1.559 ) |
108420 ( 1.953 ) |
512 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
25170934 ( 2.2x ) |
215538 ( 1.559 ) |
108420 ( 1.953 ) |
1024 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
25170935 ( 2.2x ) |
215540 ( 1.559 ) |
108420 ( 1.953 ) |
2048 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
25170934 ( 2.2x ) |
215538 ( 1.559 ) |
108420 ( 1.953 ) |
4096 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
37227804 ( 1.5x ) |
210624 ( 1.523 ) |
108420 ( 1.953 ) |
128 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
28176668 ( 2.0x ) |
210624 ( 1.523 ) |
108420 ( 1.953 ) |
256 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
25912090 ( 2.2x ) |
210616 ( 1.523 ) |
108420 ( 1.953 ) |
512 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
25467932 ( 2.2x ) |
210624 ( 1.523 ) |
108420 ( 1.953 ) |
1024 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
25467930 ( 2.2x ) |
210616 ( 1.523 ) |
108420 ( 1.953 ) |
2048 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
25467932 ( 2.2x ) |
210624 ( 1.523 ) |
108420 ( 1.953 ) |
4096 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
16341004 ( 3.4x ) |
220604 ( 1.595 ) |
92236 ( 1.661 ) |
128 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
12679330 ( 4.4x ) |
220608 ( 1.595 ) |
92236 ( 1.661 ) |
256 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
11570495 ( 4.9x ) |
220604 ( 1.595 ) |
92236 ( 1.661 ) |
512 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
11291182 ( 5.0x ) |
220606 ( 1.595 ) |
92236 ( 1.661 ) |
1024 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
11297960 ( 5.0x ) |
220606 ( 1.595 ) |
92236 ( 1.661 ) |
2048 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
11308128 ( 5.0x ) |
220608 ( 1.595 ) |
92236 ( 1.661 ) |
4096 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
37225763 ( 1.5x ) |
211256 ( 1.528 ) |
108420 ( 1.953 ) |
128 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
28174265 ( 2.0x ) |
211264 ( 1.528 ) |
108420 ( 1.953 ) |
256 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
25909529 ( 2.2x ) |
211256 ( 1.528 ) |
108420 ( 1.953 ) |
512 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
25465290 ( 2.2x ) |
211256 ( 1.528 ) |
108420 ( 1.953 ) |
1024 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
25468679 ( 2.2x ) |
211256 ( 1.528 ) |
108420 ( 1.953 ) |
2048 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
25468679 ( 2.2x ) |
211256 ( 1.528 ) |
108420 ( 1.953 ) |
4096 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
56364139 ( Base ) |
138278 ( Base ) |
55516 ( Base ) |
128 | NHWC | muRISCV-NN | Scalar | RV32GC | 0 | - |
26148996 ( 2.2x ) |
141854 ( 1.026 ) |
55588 ( 1.001 ) |
128 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
18284209 ( 3.1x ) |
141854 ( 1.026 ) |
55588 ( 1.001 ) |
256 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
14597673 ( 3.9x ) |
141854 ( 1.026 ) |
55588 ( 1.001 ) |
512 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
12918245 ( 4.4x ) |
141854 ( 1.026 ) |
55588 ( 1.001 ) |
1024 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
12102434 ( 4.7x ) |
141854 ( 1.026 ) |
55588 ( 1.001 ) |
2048 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
11491423 ( 4.9x ) |
141854 ( 1.026 ) |
55588 ( 1.001 ) |
4096 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
15262911 ( 3.7x ) |
139194 ( 1.007 ) |
55516 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
9679715 ( 5.8x ) |
139194 ( 1.007 ) |
55516 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
7133877 ( 7.9x ) |
139194 ( 1.007 ) |
55516 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
5891749 ( 9.6x ) |
139194 ( 1.007 ) |
55516 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
4966874 ( 11.3x ) |
139194 ( 1.007 ) |
55516 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
4721171 ( 11.9x ) |
139194 ( 1.007 ) |
55516 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
Anomaly Detection (toycar)
| Cycles (Speedup) | Total ROM (rel.) | Total RAM (rel.) | VLEN | Layout | Kernels | Mode | Arch | Unroll | Auto-Vectorization |
|---|---|---|---|---|---|---|---|---|---|
3203505 ( 0.5x ) |
581944 ( 1.842 ) |
5572 ( 1.168 ) |
128 | NCHW | TVM | Fallback | RV32GC | 0 | - |
3203505 ( 0.5x ) |
581944 ( 1.842 ) |
5572 ( 1.168 ) |
128 | NHWC | TVM | Fallback | RV32GC | 0 | - |
2245161 ( 0.8x ) |
609120 ( 1.928 ) |
6884 ( 1.443 ) |
128 | NCHW | TVM | Autotuned | RV32GC | 0 | - |
2245161 ( 0.8x ) |
609120 ( 1.928 ) |
6884 ( 1.443 ) |
128 | NHWC | TVM | Autotuned | RV32GC | 0 | - |
1042189 ( 1.6x ) |
581196 ( 1.839 ) |
5572 ( 1.168 ) |
128 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
1042189 ( 1.6x ) |
581196 ( 1.839 ) |
5572 ( 1.168 ) |
256 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
1042189 ( 1.6x ) |
581196 ( 1.839 ) |
5572 ( 1.168 ) |
512 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
1042189 ( 1.6x ) |
581196 ( 1.839 ) |
5572 ( 1.168 ) |
1024 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
1042189 ( 1.6x ) |
581196 ( 1.839 ) |
5572 ( 1.168 ) |
2048 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
1042189 ( 1.6x ) |
581196 ( 1.839 ) |
5572 ( 1.168 ) |
4096 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
1042189 ( 1.6x ) |
581196 ( 1.839 ) |
5572 ( 1.168 ) |
128 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
1042189 ( 1.6x ) |
581196 ( 1.839 ) |
5572 ( 1.168 ) |
256 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
1042189 ( 1.6x ) |
581196 ( 1.839 ) |
5572 ( 1.168 ) |
512 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
1042189 ( 1.6x ) |
581196 ( 1.839 ) |
5572 ( 1.168 ) |
1024 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
1042189 ( 1.6x ) |
581196 ( 1.839 ) |
5572 ( 1.168 ) |
2048 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
1042189 ( 1.6x ) |
581196 ( 1.839 ) |
5572 ( 1.168 ) |
4096 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
1343813 ( 1.3x ) |
592770 ( 1.876 ) |
6884 ( 1.443 ) |
128 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
1263925 ( 1.4x ) |
592770 ( 1.876 ) |
6884 ( 1.443 ) |
256 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
1224201 ( 1.4x ) |
592770 ( 1.876 ) |
6884 ( 1.443 ) |
512 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
1207728 ( 1.4x ) |
592770 ( 1.876 ) |
6884 ( 1.443 ) |
1024 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
1204575 ( 1.4x ) |
592770 ( 1.876 ) |
6884 ( 1.443 ) |
2048 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
1211353 ( 1.4x ) |
592770 ( 1.876 ) |
6884 ( 1.443 ) |
4096 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
1343813 ( 1.3x ) |
592770 ( 1.876 ) |
6884 ( 1.443 ) |
128 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
1263925 ( 1.4x ) |
592770 ( 1.876 ) |
6884 ( 1.443 ) |
256 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
1224201 ( 1.4x ) |
592770 ( 1.876 ) |
6884 ( 1.443 ) |
512 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
1207728 ( 1.4x ) |
592770 ( 1.876 ) |
6884 ( 1.443 ) |
1024 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
1204575 ( 1.4x ) |
592770 ( 1.876 ) |
6884 ( 1.443 ) |
2048 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
1211355 ( 1.4x ) |
592778 ( 1.876 ) |
6884 ( 1.443 ) |
4096 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
1719018 ( Base ) |
315994 ( Base ) |
4772 ( Base ) |
128 | NHWC | muRISCV-NN | Scalar | RV32GC | 0 | - |
623317 ( 2.8x ) |
316678 ( 1.002 ) |
4772 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
509400 ( 3.4x ) |
316686 ( 1.002 ) |
4772 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
452440 ( 3.8x ) |
316688 ( 1.002 ) |
4772 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
423958 ( 4.1x ) |
316682 ( 1.002 ) |
4772 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
409720 ( 4.2x ) |
316686 ( 1.002 ) |
4772 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
407936 ( 4.2x ) |
316688 ( 1.002 ) |
4772 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
618326 ( 2.8x ) |
316550 ( 1.002 ) |
4772 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
501645 ( 3.4x ) |
316548 ( 1.002 ) |
4772 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
443304 ( 3.9x ) |
316546 ( 1.002 ) |
4772 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
414457 ( 4.1x ) |
316544 ( 1.002 ) |
4772 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
410829 ( 4.2x ) |
316554 ( 1.002 ) |
4772 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
408972 ( 4.2x ) |
316548 ( 1.002 ) |
4772 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
Visual Wake Words (vww)
| Cycles (Speedup) | Total ROM (rel.) | Total RAM (rel.) | VLEN | Layout | Kernels | Mode | Arch | Unroll | Auto-Vectorization |
|---|---|---|---|---|---|---|---|---|---|
84663689 ( 0.5x ) |
546140 ( 1.686 ) |
181032 ( 2.113 ) |
128 | NCHW | TVM | Fallback | RV32GC | 0 | - |
72594453 ( 0.6x ) |
524076 ( 1.618 ) |
181032 ( 2.113 ) |
128 | NHWC | TVM | Fallback | RV32GC | 0 | - |
40394214 ( 1.1x ) |
526454 ( 1.626 ) |
181032 ( 2.113 ) |
128 | NCHW | TVM | Autotuned | RV32GC | 0 | - |
72594454 ( 0.6x ) |
524078 ( 1.618 ) |
181032 ( 2.113 ) |
128 | NHWC | TVM | Autotuned | RV32GC | 0 | - |
18322929 ( 2.5x ) |
535938 ( 1.655 ) |
181032 ( 2.113 ) |
128 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
18322927 ( 2.5x ) |
535934 ( 1.655 ) |
181032 ( 2.113 ) |
256 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
18322926 ( 2.5x ) |
535932 ( 1.655 ) |
181032 ( 2.113 ) |
512 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
18322926 ( 2.5x ) |
535934 ( 1.655 ) |
181032 ( 2.113 ) |
1024 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
18322926 ( 2.5x ) |
535932 ( 1.655 ) |
181032 ( 2.113 ) |
2048 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
18326316 ( 2.5x ) |
535934 ( 1.655 ) |
181032 ( 2.113 ) |
4096 | NCHW | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
30926458 ( 1.5x ) |
525392 ( 1.622 ) |
181032 ( 2.113 ) |
128 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
26295129 ( 1.7x ) |
525390 ( 1.622 ) |
181032 ( 2.113 ) |
256 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
24092990 ( 1.9x ) |
525394 ( 1.622 ) |
181032 ( 2.113 ) |
512 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
23175586 ( 2.0x ) |
525392 ( 1.622 ) |
181032 ( 2.113 ) |
1024 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
22810365 ( 2.0x ) |
525392 ( 1.622 ) |
181032 ( 2.113 ) |
2048 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
22782466 ( 2.0x ) |
525392 ( 1.622 ) |
181032 ( 2.113 ) |
4096 | NHWC | TVM | Fallback | RV32GCV | 0 | Loop+SLP |
20188040 ( 2.2x ) |
542862 ( 1.676 ) |
181032 ( 2.113 ) |
128 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
17067912 ( 2.7x ) |
542866 ( 1.676 ) |
181032 ( 2.113 ) |
256 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
15588382 ( 2.9x ) |
542862 ( 1.676 ) |
181032 ( 2.113 ) |
512 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
15088554 ( 3.0x ) |
542864 ( 1.676 ) |
181032 ( 2.113 ) |
1024 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
14939898 ( 3.0x ) |
542866 ( 1.676 ) |
181032 ( 2.113 ) |
2048 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
14980551 ( 3.0x ) |
542870 ( 1.676 ) |
181032 ( 2.113 ) |
4096 | NCHW | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
30920064 ( 1.5x ) |
525500 ( 1.623 ) |
181032 ( 2.113 ) |
128 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
26288479 ( 1.7x ) |
525500 ( 1.623 ) |
181032 ( 2.113 ) |
256 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
24091343 ( 1.9x ) |
525500 ( 1.623 ) |
181032 ( 2.113 ) |
512 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
23168742 ( 2.0x ) |
525498 ( 1.623 ) |
181032 ( 2.113 ) |
1024 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
22803493 ( 2.0x ) |
525502 ( 1.623 ) |
181032 ( 2.113 ) |
2048 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
22775575 ( 2.0x ) |
525500 ( 1.623 ) |
181032 ( 2.113 ) |
4096 | NHWC | TVM | Autotuned | RV32GCV | 0 | Loop+SLP |
45302675 ( Base ) |
323834 ( Base ) |
85664 ( Base ) |
128 | NHWC | muRISCV-NN | Scalar | RV32GC | 0 | - |
19678857 ( 2.3x ) |
327912 ( 1.013 ) |
85880 ( 1.003 ) |
128 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
16812457 ( 2.7x ) |
327912 ( 1.013 ) |
85880 ( 1.003 ) |
256 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
15439273 ( 2.9x ) |
327912 ( 1.013 ) |
85880 ( 1.003 ) |
512 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
14935033 ( 3.0x ) |
327912 ( 1.013 ) |
85880 ( 1.003 ) |
1024 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
14731903 ( 3.1x ) |
327914 ( 1.013 ) |
85880 ( 1.003 ) |
2048 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
14717855 ( 3.1x ) |
327910 ( 1.013 ) |
85880 ( 1.003 ) |
4096 | NHWC | muRISCV-NN | Scalar | RV32GCV | 0 | Loop+SLP |
13470573 ( 3.4x ) |
325132 ( 1.004 ) |
85664 ( 1.0 ) |
128 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
10149573 ( 4.5x ) |
325134 ( 1.004 ) |
85664 ( 1.0 ) |
256 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
8858145 ( 5.1x ) |
325132 ( 1.004 ) |
85664 ( 1.0 ) |
512 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
8354155 ( 5.4x ) |
325134 ( 1.004 ) |
85664 ( 1.0 ) |
1024 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
8309775 ( 5.5x ) |
325132 ( 1.004 ) |
85664 ( 1.0 ) |
2048 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
8313164 ( 5.4x ) |
325132 ( 1.004 ) |
85664 ( 1.0 ) |
4096 | NHWC | muRISCV-NN | Vector | RV32GCV | 0 | - |
Original data
Click here to download the raw files for this benchmark.