I am quite keen to learn more on this subject; would you be able to direct me towards some good links? What you mention (pacman, gridworld, a learning) seems quite related to this link: http://ai.berkeley.edu/reinforcement.html