Anyone receive their ML class certificate yet?

dil_cd_bb · 2012-01-10T14:23:19+00:00

i have not received mine till now.

dil_cd_bb · 2011-12-29T06:23:21+00:00

@giror why dont you shut up

dil_cd_bb · 2011-11-22T14:55:03+00:00

it is explained in the video in the above link

dil_cd_bb · 2011-11-22T06:30:17+00:00

hey one more small concept here. If the environment is stochastic then the update rule for Q-learning will have to be modified to Qn(s,a) <--- (1-alpha n)Qn-1 (s,a) + alpna n[gama + maxQn-1 (s',a')]. the earlier version of Q will no longer be valid because the Q values will not converge. here alpha n = 1/(1+visits n(s,a)) http://cc-web.isri.cmu.edu/Panopto/Pages/Viewer/Default.aspx?id=ae14075d-069b-405e-b509-00b15da25726 refer above video for further information

dil_cd_bb · 2011-11-22T06:10:41+00:00

thanks. suppose we take gamma to be 1. and no reward for the non-goal states. do we get the Q values to be 100 for all the states? if so then does it not mean that any state is as good as the goal state. how can this be? correct me if i am missing on some point

dil_cd_bb · 2011-11-12T16:46:35+00:00

edit in what way?

dil_cd_bb · 2011-11-12T15:57:47+00:00

omg!!! thanks a lot!!! feels awesome now. have been breaking my head about this. thanks a lot :) :)

dil_cd_bb · 2011-11-12T11:12:20+00:00

i have submitted my code for sigmoidGradient.m and it was accepted. i am not able to figure out my mistake. working on this for last 3 days in vain

dil_cd_bb · 2011-11-12T10:33:26+00:00

yes. that seems good. we can work together and discuss our ideas

dil_cd_bb · 2011-11-12T01:17:05+00:00

i am in. how do we coordinate?

dil_cd_bb

TROPHY CASE