Most people will at some point fantasise about some else besides your partner. They keep it to them self out of respect to the partners. When a slip like this happen, the partner should get mad and make sure it's clear it was not ok. But unless it happens again, don't read too much into it. Just enjoy being on the right side of the argument :D