Markov Chains - mrketchup/playball GitHub Wiki

This page is just a placeholder for future research to do on Markov Chains and how they can be used in the simulator.

• General info
  • http://www.pankin.com/markov/intro.htm
  • http://www.pankin.com/markov/index.html
  • http://www.tangotiger.net/markov.html
  • https://en.wikipedia.org/wiki/Subshifts_of_finite_type
  • https://en.wikipedia.org/wiki/Probabilistic_automaton
  • https://en.wikipedia.org/wiki/Markov_chain
  • https://en.wikipedia.org/wiki/Markov_chain_Monte_Carlo
  • https://en.wikipedia.org/wiki/Hidden_Markov_models
• Implementations
  • https://pypi.python.org/pypi/pymc
  • https://github.com/baudren/montepython_public
  • http://hplgit.github.io/teamods/MC_cython/sphinx/main_MC_cython.html
  • http://cran.r-project.org/web/packages/msm/index.html
  • http://sourceforge.net/projects/hydra-mcmc/