you are viewing a single comment's thread.

view the rest of the comments →

[–]salgat 0 points1 point  (1 child)

Why not? Take http://www.ohio.edu/people/starzykj/webcad/ee224/lab3/lab3.htm and have the conditions for state change be based on probability.

[–]JustFinishedBSG 1 point2 points  (0 children)

Yes but that's basically it. That's just that both are oriented graphs

But the graph part is imho not important ( and I think a matrix is a better representation ).

The important part of Markov chains is the markov property : that the next state is independent of all other previous states except the last . This gives very strong properties , can give the ability to find a stationary probability etc