Perturbed Markov Chains
Eilon Solan and Nicolas Vieille
We study irreducible time-homogenous Markov chains with finite state space in discrete time. We obtain results on the sensitivity of the stationary distribution and other statistical quantities with respect to perturbations of the transition matrix. We define a new closeness relation between transition matrices, and use graph-theoretic techniques, in contrast with the matrix analysis techniques previously used
This result is used in the paper “Approximating a Sequence of Observations by a Simple Process”.