Syllabus
Basic properties of stochastic processes.
Discrete time Markov chains. Markov chains with rewards.
Continuous time Markov chains. Poisson process, Birth and Death processes,
Markov queuing models.
Annotation
Markov chains with discrete and continuous time. Recommended for bachelor's program in General Mathematics, specialization Stochastics.