Projects, progress, milestones, signals - BIDS/reproducibility-wg GitHub Wiki

Projects

At the retreat, we identified a few projects we thought were worth doing that we haven't seen done elsewhere.

Some subsets of us self-identified as interested, but I didn't take notes on who was willing to put energy into what.

If memory serves, these are the projects. Please insert your name where appropriate:

  • vignettes/interviews with perhaps several fellows and several senior fellows (or others) about their workflows, and steps/tools/practices they use to maximize the reproducibility of their process. We thought this would be a good joint project with the ethnography group.
  • a collection of success stories and failure stories illustrating why working reproducibly pays off, even in the short term
  • a quick diagnostic "10 questions about reproducibility" that lets people quickly grade their own research for reproducibility, and identify what single step they could take next to elevate the reproducibility of their work most.

I don't think this was on the list, but we should compile a list of campus resources, training videos, short courses, etc., that teach practices and tools for reproducible work. This should include SW Carpentry, Fernando's https://github.com/fperez/reprosw , and what else? Have I forgotten anything?

Progress

Please help me compile a list of our accomplishments so far for the progress report. Among them, I count:

  • BCE (now in use at UCB and elsewhere!)
  • Statistics 157 "Reproducible and Collaborative Statistical Data Science," now in its second iteration. Current syllabus: https://github.com/ucb-stat-157/fall-2014-public
  • reproducibility incorporated into Stat 222 and 215
  • collaborating with UW and NYU on syllabi to teach reproducibility; skeletal syllabus available
  • organizing conference sessions on reproducibility, including:
    • JSM 2014
    • CSE 2015
    • various talks, including BITSS and MPE

Metrics, Milestones, "Signals"

Notes from the DSE phone calls on reproducibility are here: https://docs.google.com/document/d/1-9qbhE0W4HsOrT_ocIR-sVgxloADW90dVEluFFAi9TA/edit#

The "Preach, Evangelize, Practice" headings are likely to be adopted; we might insert those here...