Project Meeting 2016.10.21 - ActivitySim/activitysim GitHub Wiki

#Task 1 Project Management

  • OSG's budget has been re-allocated to RSG for Task 10 Full Model Run
  • What's the status of SANDAG funding some additional work later this year?
  • Bill to see if an email NTP is ok for moving Task 8 to next year and using the budget for Task 10
  • Will check the budget at the end of the month since we're almost out of funds

#Task 10 Full Model Run

  • Sped up cdap_rank calculation by replacing slow groupby.rank function with lower-level version.
  • Rewrote interaction_simulate for improved performance by streamlining the usage of the underlying pandas data structures.
  • Recoded _check_for_variability for improved performance. _check_for_variability reminds the user that some variables in expressions are all the same right now since they are not implemented (such as mode choice logsums).
  • non_mandatory_tour_frequency runtime reduced from 6 hours 43 mins to 1 hour 49 mins due to revised interaction_simulate
  • Full model run completed successfully in 9 hours and 25 minutes on modelling server with chunk size of 100K. (2,732,722 households, 7,053,334 persons); this was single threaded
  • Eventually we'll need to explore how best to thread and/or distribute these models
  • Next steps: