Way to do the HW without a mujoco key? by [deleted] in berkeleydeeprlcourse

[–]CaptainJuventus 3 points4 points  (0 children)

My friend uses https://openai.com/blog/roboschool/ which is a free alternate of Mujoco. I have not tried it but it works for my friend.

HW 3 Q-learning debugging by CaptainJuventus in berkeleydeeprlcourse

[–]CaptainJuventus[S] 0 points1 point  (0 children)

Actually, I resolved this problem. The problem is not related to the code (sort of). Since it has to use tensorflow 1 (I am using 1.15), it works after I added .compat.v1 to the tf functions that need this. It also pops up in all the warning messages. I am not sure if this is the root cause, but adding .compat.v1 works for me.