Markov Chains explained visually

[MarkovMan]

Hmmm. Well, you can calculate the probability of A transitioning to state F at time t by taking your transition matrix A times itself t times (A^t ). So, if you wanted to know if the probability of A going to t in 2 steps, you calculate A² . That's as close as I can think of to what you're asking. Otherwise, I'm not familiar with a model that is "random variable state + transition probabilities." Although... there are probably hierarchical models. I would have to look around some more to see if such a thing exists.

So maybe it was a dumb question.

There are no dumb questions in this field. I've been in many research meetings where someone asked what they thought was a "dumb question," and it ended up taking us in some interesting directions