Release Test Results: 2013.04 - greese/dasein-cloud-vcloud GitHub Wiki

This page includes the results from the Dasein Cloud integration tests for vCloud support for Dasein Cloud 2013.04.

NOTE on vCloud 1.5: vCloud 1.5 has a bug that can cause vCloud to lose track of the fact that VMware tools are installed on a VM when the powerOn command is issued via the API. As a result, imaging tests currently fail in vCloud 1.5, but they succeed in 5.1.

Results: Dell

vCloud Version: 1.5

All tests completed successfully except for imaging tests on 1 April 2013 at 00:52 UTC against [Dell's vCloud Cloud] (https://cloudconsole.dell.com).

Output

[2013-03-31 19:53:36,235] All Tests Complete ------------------------------------------------------------------------------
[2013-03-31 19:53:36,235] --------------- API Log ---------------
[2013-03-31 19:53:36,235] ---> POST captureVApp:                12
[2013-03-31 19:53:36,235] ---> POST undeploy:                   2
[2013-03-31 19:53:36,235] ---> DELETE vApp:                     1
[2013-03-31 19:53:36,235] ---> GET vAppTemplate:                497
[2013-03-31 19:53:36,235] ---> POST sessions:                   78
[2013-03-31 19:53:36,235] ---> POST deploy:                     7
[2013-03-31 19:53:36,235] ---> PUT virtualHardwareSection:      6
[2013-03-31 19:53:36,235] ---> GET vApp:                        6225
[2013-03-31 19:53:36,235] ---> POST powerOn:                    37
[2013-03-31 19:53:36,235] ---> POST composeVApp:                6
[2013-03-31 19:53:36,235] ---> GET vdc:                         600
[2013-03-31 19:53:36,236] ---> PUT networkConnectionSection:    6
[2013-03-31 19:53:36,236] ---> GET task:                        53
[2013-03-31 19:53:36,236] ---> GET catalog:                     286
[2013-03-31 19:53:36,236] ---> GET versions:                    1
[2013-03-31 19:53:36,236] ---> POST metaData:                   6
[2013-03-31 19:53:36,236] ---> POST suspend:                    1
[2013-03-31 19:53:36,236] ---> GET org:                         220
[2013-03-31 19:53:36,236] ---> GET catalogItem:                 498
[2013-03-31 19:53:36,236] ---> GET network:                     1043
[2013-03-31 19:53:36,236] ---> POST powerOff:                   1
[2013-03-31 19:53:36,236] ---> Total Calls:                     9586
[2013-03-31 19:53:36,236] 
[2013-03-31 19:53:36,236] ----------- Provisioning Log ----------
[2013-03-31 19:53:36,236] Provisioned Compute Resources:
[2013-03-31 19:53:36,236] ---> Virtual Machines:                6 {stateful=vm-c1194392-fe31-4e3e-ab2e-7483011ad74a, stateful6=vm-b3eb4b24-b6f3-4595-bfed-5a545696e12a, removed=vm-90a39d63-9c4f-4ceb-a04d-7f8517554830, testLaunch=vm-8cd12085-351b-4fb2-9ee1-9a2d241a42fb, vlanLaunch=vm-9adf63a5-2595-4399-baa3-64f6b60d3a02, filter=vm-5736a740-8072-43b8-927f-65340cfd3873}
[2013-03-31 19:53:36,236] 
[2013-03-31 19:53:36,236] --------------- Results ---------------
[2013-03-31 19:53:36,236] Tests:                                328
[2013-03-31 19:53:36,236] Skipped:                              0
[2013-03-31 19:53:36,236] Run:                                  328
[2013-03-31 19:53:36,236] Resources Provisioned:                6
[2013-03-31 19:53:36,236] Resources De-provisioned:             6
[2013-03-31 19:53:36,236] Duration:                             612 minutes 16.025 seconds
[2013-03-31 19:53:36,236] -------------------------------------------------------------------------------------------------

Exceptions

All imaging tests failed as expected due to the VMware tools bug known to exist in vCloud 1.5. All other tests succeeded.

Notes

The Maven output to stdout was lost from this test run due to the laptop freezing at the end of the test.

Results: Virtacore

vCloud Version: 5.1

All tests completed successfully except for one on 31 March 2013 at 11:46 UTC against Virtacore.

Output

[2013-03-31 06:46:42,755] All Tests Complete ------------------------------------------------------------------------------
[2013-03-31 06:46:42,755] --------------- API Log ---------------
[2013-03-31 06:46:42,755] ---> POST undeploy:                   2
[2013-03-31 06:46:42,755] ---> POST detachVolume:               2
[2013-03-31 06:46:42,755] ---> GET vAppTemplate:                2922
[2013-03-31 06:46:42,755] ---> POST sessions:                   62
[2013-03-31 06:46:42,755] ---> PUT virtualHardwareSection:      6
[2013-03-31 06:46:42,755] ---> POST powerOn:                    30
[2013-03-31 06:46:42,755] ---> DELETE disk:                     2
[2013-03-31 06:46:42,755] ---> POST composeVApp:                6
[2013-03-31 06:46:42,755] ---> GET vdc:                         186
[2013-03-31 06:46:42,755] ---> PUT networkConnectionSection:    6
[2013-03-31 06:46:42,755] ---> GET catalog:                     144
[2013-03-31 06:46:42,755] ---> GET versions:                    2
[2013-03-31 06:46:42,755] ---> POST metaData:                   10
[2013-03-31 06:46:42,755] ---> GET disk:                        201
[2013-03-31 06:46:42,755] ---> POST attachVolume:               52
[2013-03-31 06:46:42,755] ---> POST suspend:                    1
[2013-03-31 06:46:42,755] ---> DELETE vAppTemplate:             2
[2013-03-31 06:46:42,755] ---> GET org:                         84
[2013-03-31 06:46:42,755] ---> GET network:                     279
[2013-03-31 06:46:42,755] ---> GET catalogItem:                 2918
[2013-03-31 06:46:42,755] ---> POST powerOff:                   2
[2013-03-31 06:46:42,755] ---> DELETE vApp:                     1
[2013-03-31 06:46:42,755] ---> POST captureVApp:                4
[2013-03-31 06:46:42,755] ---> POST publish:                    4
[2013-03-31 06:46:42,755] ---> POST deploy:                     7
[2013-03-31 06:46:42,755] ---> GET vApp:                        4669
[2013-03-31 06:46:42,755] ---> GET task:                        61
[2013-03-31 06:46:42,755] ---> POST createDisk:                 4
[2013-03-31 06:46:42,755] ---> DELETE catalogItem:              2
[2013-03-31 06:46:42,755] ---> Total Calls:                     11671
[2013-03-31 06:46:42,755] 
[2013-03-31 06:46:42,755] ----------- Provisioning Log ----------
[2013-03-31 06:46:42,755] Provisioned Compute Resources:
[2013-03-31 06:46:42,755] ---> Machine Images:                  1 {stateful=vappTemplate-5e293c13-51d6-4872-b785-4643810fbd55}
[2013-03-31 06:46:42,755] ---> Virtual Machines:                6 {stateful=vm-175075dd-3a35-41d2-a555-9b00535f3998, stateful6=vm-bc3cfe00-a790-4c1a-a90c-e0390edf2af4, removed=vm-79839171-4f36-450e-a027-e5df5448284b, testLaunch=vm-cd4e2583-5ce5-4d79-91ec-2effa270cf2a, vlanLaunch=vm-55af6a13-6a45-46c0-a105-dee6090b5541, filter=vm-7522dd2b-2a49-4823-b69c-d2b3a0091d49}
[2013-03-31 06:46:42,755] ---> Volumes:                         3 {stateful=917cc44c-8f19-467f-8629-6c712296dcaf, removed=e223e9ce-7ee5-44df-be3c-a1772771d5cd, filter=861c7135-611b-489e-8a64-e4eade215698}
[2013-03-31 06:46:42,755] 
[2013-03-31 06:46:42,755] --------------- Results ---------------
[2013-03-31 06:46:42,755] Tests:                                328
[2013-03-31 06:46:42,756] Skipped:                              0
[2013-03-31 06:46:42,756] Run:                                  328
[2013-03-31 06:46:42,756] Resources Provisioned:                9
[2013-03-31 06:46:42,756] Resources De-provisioned:             10
[2013-03-31 06:46:42,756] Duration:                             519 minutes 59.941 seconds
[2013-03-31 06:46:42,756] -------------------------------------------------------------------------------------------------
-------------------------------------------------------
 T E S T S
-------------------------------------------------------
Running org.dasein.cloud.vcloud.TestSuite
Tests run: 328, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 31,200.308 sec <<< FAILURE!

Results :

Failed tests: 
  listShares(org.dasein.cloud.test.compute.StatefulImageTests)

Tests run: 328, Failures: 1, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 8:40:03.899s
[INFO] Finished at: Sun Mar 31 06:46:42 CDT 2013
[INFO] Final Memory: 10M/81M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.6:test (default-test) on project dasein-cloud-vcloud: There are test failures.
[ERROR] 
[ERROR] Please refer to /Users/greese/dvl/dasein-cloud/dasein-cloud-vcloud/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

Exceptions

The setup for listShares() on templates failed making the test not capable of being run. This test is not relevant to vCloud since Dasein Cloud does not implement template sharing. Furthermore, the test did succeed on a prior run when there was an important failure that was corrected for this run. Finally, the tests take 8 hours in vCloud and it's time to move on.

Notes

None