Codebook‐Training - pearce-nyu/coding-pre-post GitHub Wiki

This page is for the training process for using the codebook to tag student responses.

Coding Guideline

Prior to tagging student responses with codes from the codebook, coders should complete the following preparatory steps:

  1. Thoroughly read the entire codebook—read through all the codes—i.e., Dimensions, Level-1 categories, Level-2 categories—their descriptions, and example excerpts. The example excerpts illustrate sample data that are tagged with specific codes.
  2. Read the newspaper article that students responded to, in order to understand the context of their answers.
  3. When selecting codes to tag the excerpts, read through descriptions of the code you want to tag the excerpt with. Additionally, remember to be aware of the code’s context—i.e., the higher-level categories that the specific code belongs to (whether that’s a Level-1 category or a Dimension). The higher-level categories have descriptions that could add context to the code(s) you are considering. DO NOT rely solely on the code labels.
  4. Excerpts may be tagged with multiple codes. The codes are not mutually exclusive—the responses may reflect ideas that speak to multiple codes under the same category. For example, an excerpt may be tagged with “Modality” and “Usability” if the excerpt speaks about both (Modality and Usability are both Level-2 codes under the Interfacing Level-1 category).
  5. Excerpts under a 'pro' question don’t always describe benefits, and those under a 'con' question don’t always describe harms — they could be either.
  6. Ensure consistency across your coding. It’s helpful to go back and forth between excerpts to ensure that you are using the codes consistently. One way you can do this is to use filters in your coding sheet to view all excerpts tagged with the same code.
  7. If you encounter an excerpt (or part of it) that doesn’t fit any existing category, make a detailed note in the designated section of your coding sheet. These excerpts would be candidates for further discussion among coders to refine the codebook.