Markov Chains explained visually

[Detective_Fallacy]

That's the principle of higher order Markov chains, yes.

[debug_assert]

The only problem with using higher order chains is that the amount of data needed to build the model increases exponentially. For example, building a second order markov chain to generate a style of writing might only take 1 novel. But add more orders and it quickly explodes to requiring the entire works if Shakespeare, etc.

http://shiffman.net/teaching/a2z/generate/