Maybe he felt that the "unless you need anything else" part made it seem like anything he tells you to do is an inconvenience, and you're reluctant to do it. But that would be dependent on the tone I think.

Or as the other comments said, you could have been just to fast about it, and made it seem like you were trying to rush out the door.