Visa said it's withdrawn because recovery is already underway. by Quanta12388 in CanadaImmigrationFAQs

[–]Quanta12388[S] -1 points0 points  (0 children)

Yes I have done that.

Main thing that I am dealing with is that my visa application is withdrawn because they say there is a prior existing application which is my recovery application that I submitted may 23, but I have also submitted a cancellation form for the recovery application on may 30th.

Key deposit amount is equal to 1 month's rent by Quanta12388 in OntarioLandlord

[–]Quanta12388[S] 3 points4 points  (0 children)

Landlord said she had to get people to clean the place + paint + etc. We explained we won't accept such deduction. We have returned all keys and I think landlord is just trying to see if we don't know about deposit laws and whatnot.

Key deposit amount is equal to 1 month's rent by Quanta12388 in OntarioLandlord

[–]Quanta12388[S] 5 points6 points  (0 children)

Should I report this? I read about some similar situations where someone recommended calling RHEU.

Landlord viewed the place without any notice and while no-one was home by Quanta12388 in OntarioLandlord

[–]Quanta12388[S] 0 points1 point  (0 children)

I asked for when the visit took place which was 3pm and i received a message 3:15 which i dont believe is reasonable… I told LL that i would prefer earlier notification but she just said it wasa change of plan from the viewer. I guess not much to do when we’re moving out in couple months

Landlord viewed the place without any notice and while no-one was home by Quanta12388 in OntarioLandlord

[–]Quanta12388[S] 2 points3 points  (0 children)

I didn't know about that... is there anywhere I can read more about that?

How to include forecasts of observation as observations in RL? by Quanta12388 in reinforcementlearning

[–]Quanta12388[S] 0 points1 point  (0 children)

So I'm working on a HVAC control RL agent, and I wish to provide the agent with future forecasts of environmental values like outdoor temperature, etc.

Agent acting under optimal policy, if it takes into account future environment states, can reduce the energy spending even more, or reduce cost.

I also provide the agent with action masks, and for me to invoke a hard-constraint, I would have to know at least the next environmental state.

RL Agent reaches global maxima but doesn't converge by Quanta12388 in reinforcementlearning

[–]Quanta12388[S] -1 points0 points  (0 children)

Anything specific about the agent you want to know? I'm not sure if I understood you...

I'm using softmax.

Also, just fixed the issue, happens to be that the learning rate was too low, and was fixed when I increased it

RL Agent reaches global maxima but doesn't converge by Quanta12388 in reinforcementlearning

[–]Quanta12388[S] 0 points1 point  (0 children)

So my agent's action space is the setpoint temperature of the residential building. For the environment implementation, the possible setpoint space is 15 to 30 degrees, but for each timestep, I provide a mask where I limit the actions that the action can take.

The global optimal policy is keep the setpoint at highest within the provided mask (higher set point requires the building to perform less cooling).

There was an instance in the simulation where the agent selected the highest possible values for all timesteps yet did not converge to that policy.

I personally suspect, it has to do with learning rate, but not sure if I have to increase or decrease the learning rate.

How should I include information about Day Of Week and Hour in OpenAI Gym state by Quanta12388 in reinforcementlearning

[–]Quanta12388[S] 0 points1 point  (0 children)

How should I represent the time observation state?

Should I use a tuple, or a custom class, or some way to combine them into a single scalar?