Manual validation - codalab/codabench GitHub Wiki

This is a checklist to follow in order to perform a manual validation of the platform's proper functioning. This is especially useful when validating a "bump" pull request made by the dependabot, a fresh installation or any change in the code base.

  1. Create a user account and login
  2. Create a competition
  3. Create a queue
  4. Upload a submission
  5. Check that the submission was processed (results, visualization tab, leaderboard)
  6. Change/recover password
  7. Delete user
  8. Delete submission
  9. Delete queue
  10. Delete competition
  11. Admin page
  12. Look at the logs for any problematic messages (docker compose logs -f)