Markov chain

Markov chain is a stochastic process with the Markov property. The term "Markov chain" refers to the sequence of random variables such a process moves through, with the Markov property defining serial dependence only between the adjacent periods (as in a "chain"). It is named after the Russian mathematician Andrey Markov.

Definition

A Markov chain is a sequence of random variables X1, X2, X3, ... with the Markov property, namely that the probability of moving to the next state depends only on the present state and not on the previous states.

Properties

Markov chains have many properties, which are studied in topics such as stochastic processes, random walks, ergodic theory, and statistical mechanics. They are used as mathematical models of systems and processes in many fields.

Applications

Markov chains are used in various fields such as physics, chemistry, economics, social sciences, and engineering. They are particularly useful in the study of systems that follow a chain of linked events, which can be represented as states in a Markov chain.

See also

• Markov process
• Markov property
• Markov decision process
• Hidden Markov model

External links

• Wikipedia article on Markov chain

Markov chain Resources
Need Help Finding a Doctor? Need help finding a doctor or specialist anywhere in the world? Explore our world directory. WikiMD's DocFinder can assist you in locating millions of physicians.	Medical Knowledge Access the latest research - Most recent articles Ongoing trials.

Translate to: East Asian 中文, 日本, 한국어, South Asian हिन्दी, Urdu, বাংলা, తెలుగు, தமிழ், ಕನ್ನಡ,
Southeast Asian Indonesian, Vietnamese, Thai, မြန်မာဘာသာ, European español, Deutsch, français, русский, português do Brasil, Italian, polski