Scale and performance metrics - stolostron/search-v2-operator GitHub Wiki
Data obtained running Locust tests from Jorge's laptop/home. All response times are in milliseconds.
July 1
Data ingestion (search-indexer)
- Initial load, only local cluster added before.
- Small clusters with 5k resources. (2 new per second)
| Environment | # reqs | # fails | Avg | Min | Max | Median | req/s | failures/s |
|---|---|---|---|---|---|---|---|---|
| GP3 | 20 | 0(0.00%) | 1111 | 736 | 1418 | 1100 | 1.98 | 0.00 |
| GP3 | 100 | 0(0.00%) | 1240 | 844 | 3574 | 1200 | 1.98 | 0.00 |
| IO2 (20000 IOPS) | 20 | 0(0.00%) | 983 | 721 | 1396 | 910 | 1.99 | 0.00 |
| IO2 (20000 IOPS) | 100 | 0(0.00%) | 2849 | 733 | 14882 | 1200 | 1.98 | 0.00 |
User queries (search-api)
- 10 users (1 new per second)
- LIMIT of 1000 resources
With 20 small managed clusters
| Environment - operation | # reqs | # fails | Avg | Min | Max | Median | req/s | failures/s |
|---|---|---|---|---|---|---|---|---|
| GP3 storage | ||||||||
| gp3 - searchByCount | 38 | 0(0.00%) | 234 | 123 | 848 | 190 | 0.48 | 0.00 |
| gp3 - searchByFilter | 29 | 0(0.00%) | 181 | 86 | 386 | 130 | 0.37 | 0.00 |
| gp3 - searchByKeyword | 34 | 0(0.00%) | 310 | 167 | 956 | 250 | 0.43 | 0.00 |
| gp3 - searchComplete | 33 | 0(0.00%) | 216 | 131 | 721 | 180 | 0.42 | 0.00 |
| gp3 - searchRelatedCount | 36 | 0(0.00%) | 395 | 242 | 679 | 360 | 0.46 | 0.00 |
| gp3 - searchRelatedItems | 34 | 0(0.00%) | 2730 | 2228 | 3930 | 2600 | 0.43 | 0.00 |
| gp3 - Aggregated | 204 | 0(0.00%) | 681 | 86 | 3930 | 260 | 2.60 | 0.00 |
With 20 small managed clusters on Crunchy DB (July 7)
| Environment - operation | # reqs | # fails | Avg | Min | Max | Median | req/s | failures/s |
|---|---|---|---|---|---|---|---|---|
| GP2 storage | ||||||||
| gp2 - searchByCount | 109 | 0(0.00%) | 139 | 79 | 523 | 120 | 0.22 | 0.00 |
| gp2 - searchByFilter | 99 | 0(0.00%) | 181 | 135 | 338 | 160 | 0.20 | 0.00 |
| gp2 - searchByKeyword | 119 | 0(0.00%) | 171 | 119 | 570 | 150 | 0.24 | 0.00 |
| gp2 - searchComplete | 128 | 0(0.00%) | 102 | 66 | 760 | 77 | 0.26 | 0.00 |
| gp2 - searchRelatedCount | 115 | 0(0.00%) | 2120 | 1829 | 3253 | 2100 | 0.23 | 0.00 |
| gp2 - searchRelatedItems | 102 | 0(0.00%) | 2132 | 1790 | 3392 | 2100 | 0.20 | 0.00 |
| gp2 - Aggregated | 672 | 0(0.00%) | 785 | 66 | 3392 | 160 | 1.35 | 0.00 |
With 100 small managed clusters
| Environment - operation | # reqs | # fails | Avg | Min | Max | Median | req/s | failures/s |
|---|---|---|---|---|---|---|---|---|
| GP3 storage | ||||||||
| gp3 - searchByCount | 35 | 0(0.00%) | 1101 | 173 | 6294 | 660 | 0.17 | 0.00 |
| gp3 - searchByKeyword | 34 | 0(0.00%) | 625 | 272 | 2867 | 450 | 0.18 | 0.00 |
| gp3 - searchComplete | 37 | 0(0.00%) | 1406 | 404 | 4713 | 1100 | 0.19 | 0.00 |
| gp3 - searchRelatedCount | 40 | 0(0.00%) | 11177 | 4259 | 23247 | 9100 | 0.21 | 0.00 |
| gp3 - searchRelatedItems | 29 | 0(0.00%) | 20246 | 8411 | 47242 | 16000 | 0.15 | 0.00 |
| gp3 - Aggregated | 207 | 0(0.00%) | 5947 | 173 | 47242 | 1800 | 1.08 | 0.00 |
| IO2 20000 IOPS | ||||||||
| io2 - searchByCount | 32 | 0(0.00%) | 2172 | 606 | 6399 | 1400 | 0.17 | 0.00 |
| io2 - searchByFilter | 37 | 0(0.00%) | 927 | 240 | 6388 | 540 | 0.19 | 0.00 |
| io2 - searchByKeyword | 34 | 0(0.00%) | 952 | 239 | 7140 | 620 | 0.18 | 0.00 |
| io2 - searchComplete | 36 | 0(0.00%) | 1546 | 538 | 4227 | 1400 | 0.19 | 0.00 |
| io2 - searchRelatedCount | 41 | 0(0.00%) | 9754 | 3486 | 24846 | 7000 | 0.22 | 0.00 |
| io2 - searchRelatedItems | 25 | 0(0.00%) | 21804 | 11660 | 52084 | 18000 | 0.13 | 0.00 |
| io2 - Aggregated | 205 | 0(0.00%) | 5546 | 239 | 52084 | 1500 | 1.08 | 0.00 |
With 100 small managed clusters on Crunchy DB (July 7)
| Environment - operation | # reqs | # fails | Avg | Min | Max | Median | req/s | failures/s |
|---|---|---|---|---|---|---|---|---|
| GP2 storage | ||||||||
| gp2 - searchByCount | 67 | 0(0.00%) | 820 | 227 | 2851 | 640 | 0.13 | 0.00 |
| gp2 - searchByFilter | 68 | 0(0.00%) | 200 | 77 | 636 | 180 | 0.14 | 0.00 |
| gp2 - searchByKeyword | 75 | 0(0.00%) | 300 | 118 | 831 | 260 | 0.15 | 0.00 |
| gp2 - searchComplete | 64 | 0(0.00%) | 564 | 274 | 1558 | 500 | 0.13 | 0.00 |
| gp2 - searchRelatedCount | 71 | 0(0.00%) | 7603 | 3997 | 19633 | 7600 | 0.14 | 0.00 |
| gp2 - searchRelatedItems | 71 | 0(0.00%) | 8192 | 3743 | 16931 | 8000 | 0.14 | 0.00 |
| gp2 - Aggregated | 416 | 0(0.00%) | 3001 | 77 | 19633 | 580 | 0.83 | 0.00 |