Punchlist for Test::Stream-based version of Test-Simple to be ready to ship

• A single Test-Simple branch with proposed code and a corresponding Test-Simple dev release to CPAN (exodist)

This is the stream/master branch, now released as Test-Simple-1.302013_014.

• Single document describing all known issues (exodist to write; andk to review)

This is now in the documentation.

• Invite people to install latest dev in their daily perls for feedback
  • Write document explaining how to do so and how to roll-back (rjbs and exodist)

Document written. @rjbs and @exodist will publicize it this week.

• bleadperl delta smoke with verbose harness output with latest stable and latest dev; review line-by-line diff (exodist and ether); should be no substantive changes (outside Test-Simple tests themselves)

@exodist has done this and @rjbs reviewed. rjbs will get ether's OK.

• Update CPAN delta smoke: compare test results for all of CPAN with latest stable and latest dev (andk, leont, xdg), on Perl verisions 5.8.1, 5.20.2; both with and without threads; expect no new changes from previous list of incompatible modules doing unsupported things

• Line-by-line review of $Test::Builder::Level back compatibility support (ribasushi to review; xdg to vet results)

• Performance benchmarking; while specific workloads will vary, generally a ~15% slowdown on a "typical" workload is acceptable

  • Add patches to existing bechmarking tools in Test-Simple repo (ether and bulk88)
  • Run benchmarks on at least Linux (exodist) and Windows (volunteer needed)

rjbs ran preliminary testing and found the change in speed well under 10%. He will run again on a published branch, and will ask for Win32 results also.