Markov chain

Wiktionary

1. n. probability theory A discrete-time stochastic process with the Markov property.

GNU Webster's 1913

1. n. (Statistics) A random process (Markov process) in which the probabilities of discrete states in a series depend only on the properties of the immediately preceding state or the next preceeding state, independent of the path by which the preceding state was reached. It differs from the more general Markov process in that the states of a Markov chain are discrete rather than continuous. Certain physical processes, such as diffusion of a molecule in a fluid, are modelled as a Markov chain. See also random walk.

WordNet 3.0

1. n. a Markov process for which the parameter is discrete time values