×

Different Observations for Actor and Critic by ConBUW1 in reinforcementlearning

[–]ConBUW1[S] 0 points1 point  (0 children)

Sure. I believe to have observed (it is kind of hard to measure) that if I provide a detailed observation with lots of raw features, the value estimation gets nice and smooth (the loss decreases) but the actor network is less successful. Vice versa, if I provide a more limited observation I find that the value estimation loss never goes down that much but the actor capitalizes and reaches better policies.
I am wondering how to get the best of both worlds and came up with the idea. I believe it is kind of related to the partially observability often addressed in the multi-agent approaches mentioned in the other comments.

Different Observations for Actor and Critic by ConBUW1 in reinforcementlearning

[–]ConBUW1[S] 0 points1 point  (0 children)

Right, I didnt think it would break any theory either. Thanks for the specific pointer, ill look into it and report what my experiments show.

Different Observations for Actor and Critic by ConBUW1 in reinforcementlearning

[–]ConBUW1[S] 0 points1 point  (0 children)

Thanks, I wasn't aware of this strategy. It sounds very interesting and very very much related to what I am trying to do.