This page describes the way of working followed by 5GTANGO to perform the functional and non-functional tests over the SP and the VnV.

The steps of the DevOps workflow are:

1. Clone the repository: git clone https://github.com/sonata-nfv/tng-tests.git
2. Create a folder in for your test in the route /test/SP/test_name or /test/VNV/test_name
3. Create a README.md with the test description example
4. Create a file .robot with the definition of the test example
5. Create a new freestyle job in Jenkins with the following conditions:
   1. The job name is test-<test-name>-<test-id>. See the cases here
   2. For steps 3-7, follow the job example here. Please don't edit :D
   3. Add a String Parameter with the SP_PATH
   4. Clone the sonata-nfv/tng-test repository
   5. Under Build tab, choose 'Copy Artifacts from another project' in order to access the packages
   6. Under Build tab, choose 'Execute Shell' and write the commands to execute the test
   7. Under Post-build tab, choose 'Publish Robot Framework test results'
   8. Execute the test
   9. Check the deployment matrix to select the right place to run your test
   10. The tests will be called from a test control centre job that will parallelize the execution over the environments. So the environment selection should be an environment Variable for the execution. SP_PATH env will be injected.
   11. The results are stored as artifacts to be collected by an analyzer job

If something went wrong, you will receive an email to have a look what's happening.

We will have a test matrix where we will have the status of all tests.