CMI 5 Working Group Meeting Minutes – May 11th - AICC/CMI-5_Spec_Current GitHub Wiki
cmi5 Working Group Meeting Minutes – May 11th
Attendees
- Bill McDonald (Working Group Leader)
- Andy Johnson (ADL)
- Ben Clark (Rustici Software)
- Clayton Miller (NextPort)
- Jeremy Chapman (Pratt & Whitney)
- Mark Grant (independent)
- Charles Touron (USARMY CAC)
Notes
cmi5 Conformance Testing
AU Testing Approach
The group had an in-depth discussion about the nature of AU tests and how the would differ from LMS tests, given the design of AU's would have much more variability. Based on this discussion, the group determined that the best approach for testing AU's is as follows:
- There is really only one "scenario"
- Launch each AU in course and re-enter.
- AU Vendor/provider will provide instructions to exercise the AU features to generate enough data to verify them with AU test suite.
- Number of times and circumstances to Re-enter
- The suite will detect features with Success/Failure of each feature (Statement, data element, etc.)
- Test suite will apply rules to all of the data generated in LRS (all requirements)
- Test suite will verify returnURL behavior at launch time.
cmi5 testing requirements
The group agreed to the following to the testing requirements document:
cmi5_9.5.3_5 Assignable Unit (AU): The AU must set the "completion" property of the result to true for completed (cmi5 defined) statements.
cmi5 Specification Defects
During the review of AU testing requirements the group found that the cmi5 specification did not have specific prohibitions of AUs making cmi5 defined statements intended for only for LMS(i.e. Waived, Abandoned, Launched, Satisfied).
The group agreed to created a pull request for a future spec release to address this gap. For the current spec version, the test suite will designed to generate warnings if AU' issue LMS specific statements.
See Prohibition of AU using LMS specific Verbs #575
Discussion for next meeting
- Pull Request for AU prohibitions on LMS specific statements
All Previous cmi5 Meeting Minutes
https://github.com/AICC/CMI-5_Spec_Current/wiki
cmi5 on GitHub: