Physics Checking Agenda June 8, 2017 - GeneralizedNuclearData/SG43 GitHub Wiki

Agenda

  1. How should list of checks be compiled?

    Everyone was in agreement that putting these checks on GitHub is the easiest way to proceed

  2. What categories of errors should be used?

    1. Cross section errors
    2. Secondary particle errors
      1. Multiplicity errors
      2. Angular and energy distribution errors
    3. Resonance errors

    Dave Brown has a long list of errors that was shared with SG38 several years ago. This list was already categorized similarly to what is given above.

    Let's let the categories develop naturally as each individual/institution adds their specific set of checks to the SG43 list. To avoid making the main page too cumbersome, let's keep the main wiki page for checks/rules that apply to all particles. More specific rules should be added as a sub page on the wiki. Jeremy will put some instructions and guidelines about how to do that.

  3. What severity levels should we adopt?

    Possibilities:

    1. fatal — something really bad happened, can't continue.
    2. error — the data is clearly wrong and there is no unambiguous way to fix it.
    3. warning — the data is not perfect, but we can work around it.

    Need an error between fatal and error, perhaps violation. Also need something less severe than warning such as pedantic.

    Of course, we could adopt any number of levels; adding more than this would perhaps be too much. Most other levels are simply ignored.

  4. When reporting errors, should error numbers be used, or should a specified error message (string) be used?

    Deterministic errors. There should be a known format for the error messages.

    How are the list of error numbers/messages going to be managed into the future?

    How to interleave the error messages with other messages/errors from the checking code?

    Should we write the errors to a file? If so, we can define our own format (XML?) for the output. Dave Brown suggested JUnit.

  5. Next teleconference July 20, 9:00 AM MDT.

Attendees

(Sorry if I misspelled anyone's name, or if I forgot someone who was there.)

  1. Jeremy Conlin
  2. Kenichi Tada
  3. Doro Wiarda
  4. Dave Brown
  5. Caleb Mattoon
  6. Fausto Malvagi
  7. Mike Dunn
  8. Cédric Jouanne
  9. Andrew Holcomb

Assignments

  • Jeremy Conlin will create a wiki page for collecting the list of physics rules.
  • Each institution is responsible for adding their list of physics rules to be checked to the super list.
  • Dave Brown will write up a short introduction of the JUnit format for reporting errors. It shouldn't be comprehensive, but should give us an idea of how it looks and what how we could adopt it.

Thanks everyone for the great meeting. It went smoothly and was productive.