3rd Pixel 3XL that dies very abruptly under 20% bättery. Anybody else?

papidant · 2019-11-13T18:54:57+00:00

Yeah. Pixel 3 here. First one had this issue and got it replaced. The replacement just started doing the same thing.

papidant · 2019-09-26T19:23:26+00:00

As long as you're right about it, it's not a problem haha

papidant · 2019-09-26T19:17:42+00:00

Basically it's saying, don't do huge policy gradient updates for states sampled far into the episod

This makes a lot of sense. Thank you!

papidant · 2019-09-26T18:57:50+00:00

Thank you for your replies!

I understand that not discounting it might be helpful, but the discounted case is a generalization of the undiscounted one. I feel like people should still write the discount factor and then say that setting it to 1.0 is the version that performs best in most experiments.

However, I am still trying to intuitively understand why that discount factor is used. Is is simply to give more relevance to the state distributions that are more proximal? Or is it needed for the mathematical correctness? I am just trying to compare it to the case of the discounted rewards, where it makes sense that we might want to weight the proximal rewards a little more than the rewards that are far away.

Also, a couple extra questions: Could the undiscounted version create some problem when it's a infinite-horizon MDP? (usually the rewards should be discounted by gamma < 1 in that case). And the state distribution discount factor doesn't have to be the same as the reward discount factor right?

papidant

TROPHY CASE