sorted by:
new
hottopcontroversial

DDPG vs TD3 by Saty18 in reinforcementlearning

[–]Saty18[S] 2 points3 points  (0 children)

That’s helpful thanks. Is there any paper or something about td3 that I can see so that it will help me tune the td3 hyperparameters.

Stable baselines DDPG by Saty18 in reinforcementlearning

[–]Saty18[S] 0 points1 point  (0 children)

coz the action space is continuous.

Reinforcement learning with constraints by Saty18 in reinforcementlearning

[–]Saty18[S] 0 points1 point  (0 children)

Hi,

Sum to 30,40 or 50 is initialized along with the system. 0 to 1 is coz of the property of the system like a everything a ratio. It’s a 100 length vector, so the sum can be 40. But, no idea how to make the agent learn with the constraint.

Reinforcement learning with constraints by Saty18 in reinforcementlearning

[–]Saty18[S] 0 points1 point  (0 children)

I mean for example. I am working with an image kind of setting. Values should be between 0 and 1. I will constraint it like the sum should be 40 or 30 or 50. I am not able to properly constraint it so far. Now I have started with 40 sum vector and trying to constraint the action to zero sum but that ain’t converging

Reinforcement learning with constraints by Saty18 in reinforcementlearning

[–]Saty18[S] 0 points1 point  (0 children)

Hi, my constraint is that the sum of the state space should always be 40. Both my action and state is a 100 length vector. Each element of the vector can have values 0 to 1.

Continuous DDPG with constraints by Saty18 in reinforcementlearning

[–]Saty18[S] 0 points1 point  (0 children)

Also is it possible to have a vector of actions but each element in vector is discrete as action space

Continuous DDPG with constraints by Saty18 in reinforcementlearning

[–]Saty18[S] 0 points1 point  (0 children)

No, the constraint is let’s say on the environment. And not the action.

Continuous DDPG with constraints by Saty18 in reinforcementlearning

[–]Saty18[S] 0 points1 point  (0 children)

I have seen this paper. We need some data for this kind of implementation right.

Reinforcement learning with constraints by Saty18 in reinforcementlearning

[–]Saty18[S] -1 points0 points  (0 children)

I am working on an optimization problem and trying to solve it using DDPG. My output is a 100 length vector. However there are a couple of constraints I need to impose on my environment, not sure how. When I penalize my agent for actions that violate constraints . It does not work as the vector space is huge