History | Staff & Course Pages (2011-2018)

Child pages
  • Discrete Markov Processes, spring 2015

History | Staff & Course Pages (2011-2018)

Skip to end of metadata
Go to start of metadata

Discrete Markov Processes, spring 2015


Juha Alho

Stochastic processes are probabilistic models for random phenomena that display some forms of dependencies over time or space. Markov processes are the most important subclass of such processes: they are mathematically tractable, yet they have a wide range of applications. The primary goal of the course is to provide an introduction  to discrete state Markov processes, notably Bernoulli, Poisson, and Markov processes. The emphasis is on practical applications rather than on theoretical rigor. Illustrations include gambling problems, simple operations research, Markov chain Monte Carlo, and Google’s PageRank. R program may be used in practical calculations.


To pass the course, students will complete 3-4 homework sets that are graded. These form 2/3 of the final grade. In addition, a small (2 hour) final grade is worth 1/3.


The course will be given at the level of Advanced Studies (syventävät opinnot) in Statistics. 


A prerequisite for the course is probability theory at the level of Subject Studies. If in doubt, contact the lecturer. Part of the course material comes from Cinlar (1975) Introduction to Stochastic Processes, especially chapters 4-5.


The course will be given in English,

during 10.03.2015 -29.04.2015,

Tuesdays, Wednesdays at 10-12,

in Exactum B120.



Register for the course

Did you forget to register? Please contact tilasto-info[at]helsinki.fi

  • No labels