Markov Chains and Applications

Markov Chains and Hidden Markov Chains are ubiquitous in many applications where correlated data sequences are observed (speech and image processing, network modelling, …). Among important applications of these models, queuing theory, simulation of random phenomena or control of Markov Chains are very important topics for data sciences and will be studied more specifically.