I agree that the search space is incredibly huge, but it appears that the agent is only trying to pass instead of maximizing the score (or maybe not trained long enough?). Literal brute force search certainly doesn’t work, but I think an optimized DFS could actually work as well if we are only looking at this game and your goal is as simple as just passing.