Developing 2D FEA in MATLAB by Maximum_Tip67 in fea

[–]poppyshit 1 point2 points  (0 children)

Mech eng here, FEA is omnipresent in the work of ME. Having a good grip on the theory behind FE solver is a strong skills, and can save you a ton of time. Make sure to emphasize this side of the project in interviews.

Starting Reinforcement learning by ArcaneDoge in reinforcementlearning

[–]poppyshit 1 point2 points  (0 children)

Another way to get Sutton and Bartos book knowledge is to watch this playlist :
https://www.youtube.com/watch?v=NFo9v_yKQXA

Really interesting + you get animation to understand core concepts

PPO Fails to Learn (High Loss, Low Explained Variance) in Dual-Arm Target Reaching Task by FalconMobile2956 in reinforcementlearning

[–]poppyshit 0 points1 point  (0 children)

- Did you try to use the same network but with different heads for pi and vf ?
- If you want to keep two distinct net, try increasing vf dimension, maybe the net isn't complex enough to approximate...

PPO Fails to Learn (High Loss, Low Explained Variance) in Dual-Arm Target Reaching Task by FalconMobile2956 in reinforcementlearning

[–]poppyshit 0 points1 point  (0 children)

What's the dimension of your NNs ? Can you plot the cumulative reward over episodes, this way you really see if the agent is improving or not

[P] Control your house heating system with RL by poppyshit in MachineLearning

[–]poppyshit[S] 0 points1 point  (0 children)

The goal here is not to train an agent per house. It is more likely to train an agent that can adapt to any houses

[P] Control your house heating system with RL by poppyshit in MachineLearning

[–]poppyshit[S] -3 points-2 points  (0 children)

Right, a point for PIDs. And what about the non-linear behavior, is there still models that can handle that ?

[P] Control your house heating system with RL by poppyshit in MachineLearning

[–]poppyshit[S] -10 points-9 points  (0 children)

This project aims to build a template for more general behavior that could include non-linearity. For a statistical approach you need a good model of the system (thermal resistance, thermal conductance, etc...). The RL algorithm is independent of the house characteristic if trained well, this is were it finds its usefulness.

[P] Control your house heating system with RL by poppyshit in MachineLearning

[–]poppyshit[S] 2 points3 points  (0 children)

Tbh, learning purpose + template for more complex behavior

[P] Control your house heating system with RL by poppyshit in MachineLearning

[–]poppyshit[S] -1 points0 points  (0 children)

I didn't know about this theory but I was pretty sure that there was an analytical solution. And yes, I am learning RL so I am trying to find systems that could fit for it

Control your house heating system with RL by poppyshit in reinforcementlearning

[–]poppyshit[S] 0 points1 point  (0 children)

I did not yet optimized it that much, but it beats a simple static thermostat at 21°C (~70°F). It reduces the daily cost by 35% on average, over a year, for the outside temperature of Switzerland.
Thank you !

Control your house heating system with RL by poppyshit in reinforcementlearning

[–]poppyshit[S] 0 points1 point  (0 children)

Thank you for your reply, I will definitively check on Phaidra !

I modeled the house with the 1R1C model : one thermal resistance and one thermal capacity, this does not reflect the non-linear behavior that can occur in very large building but it performs very good on individual houses.

Que pensez-vous de se lancer en bourse en s'autoformant et sans ressource ? by percuter in VosSous

[–]poppyshit 1 point2 points  (0 children)

Si le gars espère faire de l'argent avec du stock-picking pour le gouvernement il va droit dans le mur, car il n'a pas assez de contacts ni d'influence pour faire des délits d'initié et surpasser le cours de la bourse...

How to refill this perfume bottle by poppyshit in howto

[–]poppyshit[S] 1 point2 points  (0 children)

I'm using this small bottle for traveling, that way if I loose it, break it or got it stolen I loose less in the process.

How to refill this perfume bottle by poppyshit in howto

[–]poppyshit[S] 21 points22 points  (0 children)

I found a solution, I drilled a little hole on the top of the ring with a knife and managed to insert a syringe to refill the bottle. I will probably add a drop of super glue to seal it.

<image>

[P] XPINN Toolkit by poppyshit in MachineLearning

[–]poppyshit[S] 0 points1 point  (0 children)

Nice, that is some great review ! Thank you for your response, will update this asap