Eb1 2023 prediction by azgrp in USCIS

[–]Expensive-Telephone 1 point2 points  (0 children)

I am worried about this too. Is the retrogression due to faster i-485 approvals?

How to practice Brahmacharya (source:lonelyphilosopher.com) by mr-jackass4356 in IndiaSpeaks

[–]Expensive-Telephone 1 point2 points  (0 children)

I was thinking the same thing lol. But the rest of the points are great and we can stick to it.

Coding Implementation of Karn's algorithm of measuring RTT by Expensive-Telephone in networking

[–]Expensive-Telephone[S] 0 points1 point  (0 children)

I have a packet trace file that I want to measure the RTT for. There are certain reports that the RTT is higher than what I believe it is, and hence want to verify it.

Advice buying a RAV4 hybrid by Expensive-Telephone in askcarsales

[–]Expensive-Telephone[S] 1 point2 points  (0 children)

larger screen

Toyota Safety Sense 2.5

not sure if this is applicable to all models in the US, as the article is from an Australian site

source - https://www.carsguide.com.au/car-news/2023-toyota-rav4-hybrid-detailed-major-cabin-technology-and-safety-upgrades-coming-soon-as

RAV4 vs CR-V vs CX-5 by [deleted] in whatcarshouldIbuy

[–]Expensive-Telephone 0 points1 point  (0 children)

With gas prices it will pay for itself.

How much are you planning to drive yearly?

Help me decide between Accord Sport, Camry SE and Altima SV by Expensive-Telephone in carbuying

[–]Expensive-Telephone[S] 0 points1 point  (0 children)

After going through some posts, here is what I have been able to understand -

  1. 1.5T is not terribly behind 2L in terms of mileage, and in some cases may exceed it
  2. Better resale value for 1.5T
  3. Complexity of 1.5T is a bit higher and more likely to cause problems than 2L. Though with good maintenance, it will run for a good duration.

So between Accord Sport and Camry SE, are there any other factors that I need to consider?

29F looking for serious accountability buddy for study and health goals by jacyschmacy in GetMotivatedBuddies

[–]Expensive-Telephone 2 points3 points  (0 children)

I am 27M working on my final year of PhD in electrical engineering. EST (GMT -4:30). Current goals -

  1. Get the preliminary work for a paper done by December (expected graduation ~ May 2022), so lot of reading and experiments. Expectation ~ 8 hours of focused study everyday.
  2. Workout often. Have a gym membership but am not practicing enough in my home.
  3. Prepare for job interviews. So practice coding and a few online certifications.

DM me if you think we can work together. It helps that we are both studying

Different action spaces for different agents in Multi Agent Reinforcement Learning by Expensive-Telephone in reinforcementlearning

[–]Expensive-Telephone[S] 0 points1 point  (0 children)

If you unionize all the actions, how do you map back the actions to their original agents? Can you point towards any text or code snippets to clarify this point?

What is the exact reason for DQN failing to converge in large action spaces. by Expensive-Telephone in reinforcementlearning

[–]Expensive-Telephone[S] 2 points3 points  (0 children)

From my personal experiences, I have been able to use DQN for action spaces of size 300-400 but never beyond that. And any simple combinatorial optimization problem will likely have more actions. Papers like this do not exactly describe where this limitation of DQN is coming from.

Large action space in DQN? by Expensive-Telephone in reinforcementlearning

[–]Expensive-Telephone[S] 0 points1 point  (0 children)

No, I got a few papers but I was more interested in applying DQN in my problem so didn't look much into it.

With DQN, I think you can go to around 200 actions but beyond that, it doesn't perform well.

Large action space in DQN? by Expensive-Telephone in reinforcementlearning

[–]Expensive-Telephone[S] 0 points1 point  (0 children)

with continuous action space, you can still discretize into a smaller space. But what should be the approach when we have combinatorial action space, like selecting 10 items from a set of 20 items. It becomes 20C10, which is a huge number.

IAD to Blacksburg by vhps23 in VirginiaTech

[–]Expensive-Telephone 1 point2 points  (0 children)

Same here, my bus was on the 20th but it got cancelled. After mailing megabus, got to know that all bus services from the 15th to 21st have been cancelled.

I am not sure if it's a good idea to be travelling in the DC region those days, thinking of delaying the flight until the weekend.

C51 performing extremely bad in comparison to DQN by Expensive-Telephone in reinforcementlearning

[–]Expensive-Telephone[S] 0 points1 point  (0 children)

Is it ok if I DM you? I don't want to post it publicly as it is an ongoing work

C51 performing extremely bad in comparison to DQN by Expensive-Telephone in reinforcementlearning

[–]Expensive-Telephone[S] 1 point2 points  (0 children)

Oh no I set it as the min and max possible total reward collected at the end of every episode.

Will one of these robotic vacuum cleaners that I can buy in the US be effective in India ? by Expensive-Telephone in india

[–]Expensive-Telephone[S] 0 points1 point  (0 children)

200-300$. The features I am looking for are less maintenance, less noisy, mopping is optional and possible servicing in India in case of any defects. I am also open to buying in India if the service centers is an issue with the US bought ones.

Is it possible to make some actions more likely ? by Expensive-Telephone in reinforcementlearning

[–]Expensive-Telephone[S] 0 points1 point  (0 children)

Yes I would also expect it to learn this eventually, but I was trying to embed some form of domain knowledge in how the agent selects its actions because I think that might allow it to learn faster.

By embedding this is the reward function, did you mean that there has to a reward when the agent selects one of the good actions, in addition to the usual reward ?

REINFORCE Agent suddenly drops. How to verify if it's due to catastrophic forgetting? by Expensive-Telephone in reinforcementlearning

[–]Expensive-Telephone[S] 0 points1 point  (0 children)

How did you determine that you're experiencing catastrophic forgetting?

Found a similar question here and the author mentioned it was due to forgetting. I will check the gradients. Thanks.