E2E TEST REPORT FOR TAG:v1.1.0 arm - flomesh-io/osm GitHub Wiki

Using Pipy as osm data plane, E2E test cases status as below:

Download Excel report

No Context ARM64 AMD64
01 CertManagerSimpleClientServer :heavy_check_mark: :heavy_check_mark:
02 SimpleClientServer traffic test involving osm-controller restart: HTTP :heavy_check_mark: :heavy_check_mark:
03 DebugServer :heavy_check_mark: :heavy_check_mark:
04 DeploymentsClientServer :heavy_check_mark: :heavy_check_mark:
05 HTTP egress policy without route matches :heavy_check_mark: :heavy_check_mark:
06 HTTP egress policy with route match :heavy_check_mark: :heavy_check_mark:
07 HTTPS egress policy :heavy_check_mark: :heavy_check_mark:
08 TCP egress policy :heavy_check_mark: :heavy_check_mark:
09 Egress :heavy_check_mark: :heavy_check_mark:
10 Fluent Bit deployment :heavy_check_mark: :heavy_check_mark:
11 Fluent Bit output :heavy_check_mark: :heavy_check_mark:
12 Garbage Collection :heavy_check_mark: :heavy_check_mark:
13 gRPC insecure traffic origination over HTTP2 with SMI HTTP routes :heavy_check_mark: :heavy_check_mark:
14 gRPC secure traffic origination over HTTP2 with SMI TCP routes :heavy_check_mark: :heavy_check_mark:
15 HashivaultSimpleClientServer :heavy_check_mark: :heavy_check_mark:
16 Test health probes can succeed :heavy_check_mark: :heavy_check_mark:
17 Helm install using default values :heavy_check_mark: :heavy_check_mark:
18 Ignore Label :heavy_check_mark: :heavy_check_mark:
19 HTTP ingress with IngressBackend :heavy_check_mark: :heavy_check_mark:
20 When OSM is Installed :heavy_check_mark: :heavy_check_mark:
21 Test IP range exclusion :heavy_check_mark: :heavy_check_mark:
22 Version v1.22.8 :heavy_check_mark: :heavy_check_mark:
23 Version v1.21.11 :heavy_check_mark: :heavy_check_mark:
24 Custom WASM metrics between one client pod and one server :droplet: :droplet:
25 Multiple service ports :heavy_check_mark: :heavy_check_mark:
26 Multiple services matching same pod :heavy_check_mark: :heavy_check_mark:
27 Becomes ready after being reinstalled :heavy_check_mark: :heavy_check_mark:
28 PermissiveToSmiSwitching :heavy_check_mark: :heavy_check_mark:
29 Permissive mode HTTP test with a Kubernetes Service for the Source :heavy_check_mark: :heavy_check_mark:
30 Permissive mode HTTP test without a Kubernetes Service for the Source :heavy_check_mark: :heavy_check_mark:
31 Test traffic flowing from client to server with a Kubernetes Service for the Source: HTTP :heavy_check_mark: :heavy_check_mark:
32 Test traffic flowing from client to server without a Kubernetes Service for the Source: HTTP :heavy_check_mark: :heavy_check_mark:
33 Test global port exclusion :heavy_check_mark: :heavy_check_mark:
34 Test pod level port exclusion :heavy_check_mark: :heavy_check_mark:
35 proxy resources :heavy_check_mark: :heavy_check_mark:
36 Enable Reconciler :heavy_check_mark: :heavy_check_mark:
37 SMI TrafficTarget is set up properly :heavy_check_mark: :heavy_check_mark:
38 SMI Traffic Target is not in the same namespace as the destination :heavy_check_mark: :heavy_check_mark:
39 SimpleClientServer TCP with SMI policies :heavy_check_mark: :heavy_check_mark:
40 SimpleClientServer TCP in permissive mode :heavy_check_mark: :heavy_check_mark:
41 SimpleClientServer egress TCP :heavy_check_mark: :heavy_check_mark:
42 TCP server-first traffic :heavy_check_mark: :heavy_check_mark:
43 HTTP recursive traffic splitting with SMI :heavy_check_mark: :heavy_check_mark:
44 TCP recursive traffic splitting with SMI :heavy_check_mark: :heavy_check_mark:
45 ClientServerTrafficSplitSameSA :heavy_check_mark: :heavy_check_mark:
46 HTTP traffic splitting - root service selector matches backends :heavy_check_mark: :heavy_check_mark:
47 HTTP traffic splitting with SMI :heavy_check_mark: :heavy_check_mark:
48 TCP traffic splitting with SMI :heavy_check_mark: :heavy_check_mark:
49 HTTP traffic splitting with Permissive mode :heavy_check_mark: :heavy_check_mark:
50 Tests upgrading the control plane :droplet: :droplet:
51 With SMI Traffic Target validation enabled :heavy_check_mark: :heavy_check_mark:
52 With SMI validation disabled :heavy_check_mark: :heavy_check_mark:

:droplet: Skip list

  • Pipy doesn't support WASM extension

How to run

Follow e2e guide for executing e2e testcases.