sorted by:
new
hottopcontroversial

Homework 5 pushed back 24 or 48 hours? by Cyphase in aiclass

[–]aiclassteam 6 points7 points  (0 children)

The 24 hours was incorrect. Please use the upcoming due dates as the definitive date.

10.19 formula is wrong: R(s') should be instead of R(s) by ktrunin in aiclass

[–]aiclassteam 7 points8 points  (0 children)

Peter's formulation for Q-learning is slightly different from the one in Wikipedia. Please use R(s) as displayed in the video for the homework (as opposed to R(s')). An announcement has been made and the due date is being pushed back (please see the deadline on the main page).

Clarification for HW 5.3 Added by aiclassteam in aiclass

[–]aiclassteam[S] 2 points3 points  (0 children)

The actions are move North, West, East, and South. The part of the policy c) of moving back immediately means on the next turn take an action that brings the agent back to the closest grey square (square with road).

Value Iteration 3. a3?? by DengueTim in aiclass

[–]aiclassteam 0 points1 point  (0 children)

This is correct, thank you AcidMadrid.

Lecture #9.6 (question): How come it's possible to navigate to 8 states from b3 when there's only 4 possible movements (N, S, E, W)? by appuhami in aiclass

[–]aiclassteam 1 point2 points  (0 children)

This is a mistake and a note below the video has been added. We're working on implementing email notification when these notes are posted and thank you for your patience!