CMI 5 Working Group Meeting Minutes January 23rd, 2015 - AICC/CMI-5_Spec_Current GitHub Wiki

CMI 5 Working Group Meeting Minutes - January 23rd, 2015

Attendees

  • William A. McDonald – Boeing Flight Services
  • Andy Johnson – ADL
  • Tyler Mulligan - ADL
  • Henry Ryng – INXSOL
  • Vijay Budhram - Rip Tide
  • Nick Washburn - Rip Tide
  • Art Werkenthin – RISC
  • Ray Lowery – Pratt & Whitney

If I missed anyone, please let me know…

Notes

CMI-5 Conformance Testing Procedures The group continued its discussion of conformance testing procedures for the CMI-5 Course Structure

The following test procedure overview was discussed in more detail based on last week’s meeting.

Export Test

1.Import a Reference Course Structure

2.Use any course editing features that the LMS has

3.Export the course Structure

4.Validate Exported Course Structure

  • XSD Schema – validation (by computer)
  • Additional Data Validation- Data Compare import/export data (not a whole file compare - )
  • No Human checks needed.

On reviewing the export test process, the group found that the CMI-5 XSD schema needs to be updated to centralize objectives definitions per previous meeting agreements.

LMS Runtime Testing Scenarios.

A course structure generated by TestSuite would likely be tied to runtime tests.

AU Launch Tests

  • Launch AU
  • Authentication -Fetch URl - twice
  • Check Launch parameters
  • Verify the window (new window / any window)
  • Verify LMS Verb statements
  • Partially complete.
  • Exit.
  • Re-launch.
  • Verify previous state data was stored correctly.
  • Complete the AU (Different Scenarios-based on moveOn) ** Complete ** Passed (Verify Mastery Score)
    • Both (Verify Mastery Score)

Looking ahead on CMI-5 compliance testing

Overall CMI-5 Compliance testing will have 2 major components:

  1. XAPI Compliance

  2. CMI-5 Specific Compliance

Multiple groups in the xAPI community are studying compliance testing software (TestSuite) and possible organizational structures to support independent, 3rd party, testing.

It is hoped that the CMI-5 compliance testing process can leverage whatever work is being done for xAPI compliance testing.

Link to Draft xAPI testing specification. https://github.com/adlnet/xAPI_LRS_Test

cmi5 Working Group Wiki

⚠️ **GitHub.com Fallback** ⚠️