Metrics - NextensArelB/SwaggerGenerationTool GitHub Wiki

For QA the following metrics are defined

Test automation

- Unit test

  • Coverage report: A dashboard in time (displayed per week) with coverage % and differences per week
  • Status report: A dashboard where per pipeline per last 5 days is displayed:
    • coverage %
    • passed/failed %

- API test

  • Coverage report: A dashboard in time (displayed per week) with coverage end points % and differences per week
  • Status report: A dashboard per API per last 5 days is displayed
    • coverage end points %
    • passed/failed %

- UI test

  • Coverage report: A dashboard in time (displayed per week) with coverage of UI screens % and differences per week (wat zegt dit, want we willen/hoeven niet alle UI te dekken)
  • Status report: A dashboard per API per last 5 days is displayed
    • coverage UI %
    • passed/failed %

- Overall

  • Coverage report: A dashboard in which is made visible which pipeline has review, unit test, API tests part of the pipeline process (so no review or failures in unit/API tests stops the pipeline)
  • Coverage report: A dashboard in time (displayed per week) which displays the number of tests added to the pipeline in total
  • Status report: A dashboard in time (displayed per week) which displays the number of tests passed/failed in pipeline in total
  • Status report: A dashboard in time (displayed per week) which displays the total runtime of tests in pipeline in total

The following issues are in place:

  • different devops projects have different pipeline definitions, which makes it difficult to have 1 consistent reporting
⚠️ **GitHub.com Fallback** ⚠️