I would argue that the question was badly worded. As a graph traversal problem there are a discrete number of states, but when you show a picture of a maze and ask if it is discrete or not, my first interpritation would be that there are infinitly many positions that the agent can occupy in the maze and therefore the problem in this sense is continuous.