Harbor 2.10.0 - goharbor/perf GitHub Wiki
Data Size Definition
| Resource | Small | Medium |
|---|---|---|
| Projects count | 100 | 200 |
| Repositories count(per project) | 100 | 200 |
| Artifacts count(per repository) | 10 | 20 |
| Artifacts total | 100000 | 800000 |
| Artifact tags count(per artifact) | 5 | 10 |
| Users count | 100 | 200 |
| Project members count | 10 | 20 |
| Audit logs count | 500000+ | 5000000+ |
Environment
| Type | Description |
|---|---|
| Hosts | 4 * AMD EPYC 7402P 24-Core Processor / 64GB |
| Kubernetes | 1 * master , 3 * worker (v1.23.6) |
| Harbor | https://github.com/goharbor/harbor-helm (standard deploy) |
| Storage | https://github.com/openebs/dynamic-nfs-provisioner |
Report
Small Size
Concurrency 500
Harbor Performance Testing Report
| API | Avg | Min | Med | Max | P(90) | P(95) | Success Rate | Iterations Rate |
|---|---|---|---|---|---|---|---|---|
| get-artifact-by-digest | 83.98ms | 5.43ms | 57.89ms | 199.39ms | 177.2ms | 186.65ms | 100% | 377.06/s |
| get-artifact-by-tag | 119.16ms | 4.6ms | 85.46ms | 302.79ms | 279.67ms | 291.52ms | 100% | 2893.72/s |
| get-catalog | 1.4s | 174.24ms | 1.16s | 3.37s | 3.01s | 3.26s | 100% | 295.27/s |
| get-project | 106.76ms | 5.93ms | 104.01ms | 280.3ms | 234.03ms | 253.49ms | 100% | 3298.87/s |
| get-repository | 115.95ms | 8.52ms | 114.18ms | 302.64ms | 257.49ms | 285.32ms | 100% | 2984.96/s |
| get-v2 | 54.72ms | 1.93ms | 43.86ms | 168.39ms | 119.52ms | 157.68ms | 100% | 5913.50/s |
| list-artifact-tags | 109.66ms | 8.17ms | 69.57ms | 291.79ms | 248.03ms | 276.6ms | 100% | 3406.26/s |
| list-artifacts | 481.66ms | 129.33ms | 472.86ms | 1s | 639.72ms | 685.94ms | 100% | 943.33/s |
| list-audit-logs | 1.85s | 43.06ms | 1.54s | 4.38s | 3.92s | 4.14s | 100% | 225.14/s |
| list-project-logs | 111.78ms | 7.3ms | 109.09ms | 285.33ms | 245.67ms | 261.96ms | 100% | 3405.58/s |
| list-project-members | 78.46ms | 5.67ms | 47.56ms | 189.04ms | 175.18ms | 178.31ms | 100% | 5196.08/s |
| list-projects | 402.06ms | 18.95ms | 362.21ms | 925.82ms | 726.85ms | 799.02ms | 100% | 1044.85/s |
| list-quotas | 311.78ms | 176.14ms | 270.98ms | 427.81ms | 419.16ms | 422.39ms | 100% | 1376.18/s |
| list-repositories | 151.36ms | 12.96ms | 125.92ms | 401.07ms | 352.94ms | 381.56ms | 100% | 2471.50/s |
| list-users | 56.57ms | 4.18ms | 40.35ms | 155.68ms | 117.35ms | 123.65ms | 100% | 5937.48/s |
| pull-artifacts-from-different-projects | 3.32s | 505.45ms | 3s | 8.16s | 6.16s | 6.89s | 100% | 18.92/s |
| pull-artifacts-from-same-project | 29.34s | 301.41ms | 26.22s | 76.17s | 62.09s | 68.84s | 100% | 13.03/s |
| push-artifacts-to-different-projects | 6s | 898.16ms | 5.51s | 13.75s | 10.26s | 11.58s | 100% | 16.99/s |
| push-artifacts-to-same-projects | 86.56s | 2.8s | 76.59s | 226.39s | 169.75s | 190.25s | 100% | 4.06/s |
| search-users | 70.21ms | 3.99ms | 49.74ms | 174.18ms | 148.12ms | 155.74ms | 100% | 5548.97/s |
Medium Size
Concurrency 500
Harbor Performance Testing Report
| API | Avg | Min | Med | Max | P(90) | P(95) | Success Rate | Iterations Rate |
|---|---|---|---|---|---|---|---|---|
| get-artifact-by-digest | 87.52ms | 4.47ms | 50.79ms | 196.48ms | 178.43ms | 184.76ms | 100% | 322.28/s |
| get-artifact-by-tag | 118.57ms | 4.92ms | 107.68ms | 311.44ms | 283.07ms | 298.47ms | 100% | 2769.49/s |
| get-catalog | 22s | 16.7s | 21.48s | 29.24s | 24.33s | 24.46s | 100% | 21.73/s |
| get-project | 142.76ms | 10.38ms | 136.14ms | 379.81ms | 309.41ms | 345.7ms | 100% | 2431.10/s |
| get-repository | 67.86ms | 3.63ms | 15.78ms | 181.82ms | 162.3ms | 167.33ms | 100% | 4246.98/s |
| get-v2 | 42.62ms | 1.31ms | 22.88ms | 150.35ms | 125.35ms | 138.2ms | 100% | 6629.68/s |
| list-artifact-tags | 154.86ms | 11.9ms | 105.65ms | 385.3ms | 363.27ms | 374.41ms | 100% | 2581.19/s |
| list-artifacts | 1.55s | 348.63ms | 1.57s | 2.86s | 2.52s | 2.55s | 100% | 310.80/s |
| list-audit-logs | 252.64s | 6.58s | 227.95s | 627.6s | 530.35s | 563.65s | 100% | 1.37/s |
| list-project-logs | 956.78ms | 326.64ms | 895.98ms | 1.66s | 1.55s | 1.58s | 100% | 464.94/s |
| list-project-members | 135.33ms | 8.22ms | 148.34ms | 364.98ms | 207.74ms | 254.34ms | 100% | 2643.89/s |
| list-projects | 1.03s | 125.75ms | 946.98ms | 2.36s | 1.65s | 1.89s | 100% | 409.94/s |
| list-quotas | 381ms | 97.62ms | 330.12ms | 575.89ms | 510.31ms | 539.5ms | 100% | 1089.31/s |
| list-repositories | 357.02ms | 23.95ms | 402.6ms | 802.8ms | 623.91ms | 676.58ms | 100% | 1226.99/s |
| list-users | 77.31ms | 3.9ms | 42.03ms | 188.45ms | 165.36ms | 169.13ms | 100% | 4946.22/s |
| pull-artifacts-from-different-projects | 3.27s | 313.29ms | 2.88s | 8.57s | 5.89s | 6.71s | 100% | 8.77/s |
| pull-artifacts-from-same-project | 29.59s | 526.12ms | 26.35s | 76.08s | 62.28s | 69.45s | 100% | 13.00/s |
| push-artifacts-to-different-projects | 12.58s | 3.37s | 12.12s | 27.38s | 18.61s | 21.75s | 100% | 8.95/s |
| push-artifacts-to-same-projects | 93.17s | 3.07s | 83.9s | 240.44s | 178.31s | 204.5s | 100% | 3.03/s |
| search-users | 70.23ms | 4.11ms | 61.34ms | 182.82ms | 129.59ms | 134.73ms | 100% | 5253.25/s |