Markov Chains: Theory and Applications
Markov chains are a fundamental class of stochastic processes. They are widely used to solve problems in a large number of domains such as operational research, computer science, communication networks and manufacturing systems. The success of Markov chains is mainly due to their simplicity of use, the large number of available theoretical results and the quality of algorithms developed for the numerical evaluation of many metrics of interest.
The author presents the theory of both discrete-time and continuous-time homogeneous Markov chains. He carefully examines the explosion phenomenon, the Kolmogorov equations, the convergence to equilibrium and the passage time distributions to a state and to a subset of states. These results are applied to birth-and-death processes. He then proposes a detailed study of the uniformization technique by means of Banach algebra. This technique is used for the transient analysis of several queuing systems.
Betal nemt med kort, Klarna, Apple Pay eller Google Pay. Ikke tilfreds? Du har altid 14 dages fortrydelsesret. Læs mere i vores vilkår. Har du spørgsmål, så send os en mail på hello@memmo.org.
Memmo gør det nemmere at studere – uanset hvor du er i verden. Hos os samler du dine kursusbøger og smarte studieværktøjer ét sted: resuméer, quizzer, podcasts og flashcards. Og så er der Ted, din studieven, der svarer på alt, du undrer dig over. Over 50 000 studerende studerer allerede her – bygget til at hjælpe dig med at lære hurtigere og stresse mindre.