Geometric Interpretation and Manifold Structure of Markov Matrices

Abstract

In probability theory and statistics, the term Markov property refers to the memoryless property of a stochastic process. It is named after the Russian mathematician Andrey Andreyevich Markov. Every Markov matrix gives a linear equation system, and the solution of this equation system gives us a subset of $\mathbb{R}_{n}^{n}$. This paper presents the new manifold structure on the set of the Markov matrices. In addition, this paper presents the set of Markov matrices is drawable, and this gives geometrical interpretation to Markov matrices. For the proof, we use the one-to-one corresponding among $n \times n$ Markov matrices, the solution of linear equation system from derived Markov property, and the set of $(n-1)$-polytopes.

Keywords

• Convex polytope
• geometry
• manifold
• Markov matrices

References

1. [1] Basharin, G.P., Langville, A.N., Naumov, V.A., The life and work of A.A. Markov, Linear Algebra Appl. 386(2004), 3-26.
2. [2] Bernhard, J., The geometry of Markov chain limit theorems, Markov Processes. Related Fields. 19(1)(2003), 99-124.
3. [3] Boothby, W.M., An Introduction to Differentiable Manifolds and Riemannian Geometry, Academic Press California, 1975.
4. [4] Helgason, S., Differential Geometry, Lie Groups and Symmetric Space. AMS Edition, Providence, 2001.
5. [5] Privault, N., Understanding Markov Chains, Springer, Singapore, 2013.
6. [6] Pullman, N., The geometry of finite Markov chains, Canad. Math. Bull. 8(3)(1965), 345-358.
7. [7] Sumner, J.G., Fernandez-Sanchez, J., Jarvis, P.D., Lie Markov models, J. Theoret. Biol. 2012(2012), 298.
8. [8] Sumner, J.G., Lie geometry of 2 x 2 Markov matrices, J. Theoret. Biol. 327(2013), 88-90.