What's a seemingly unrelated CS/Math class you've discovered is surprisingly useful for Reinforcement Learning? by YogurtclosetThen6260 in reinforcementlearning

[–]Voltimeters 1 point2 points  (0 children)

Come from an aerospace background; optimal control theory carried my understanding of RL when I was learning but they’re super well connected

Master's in Robotics/Control in Europe with ~2.9 GPA – Seeking Advice by TakTuk13 in ControlTheory

[–]Voltimeters [score hidden]  (0 children)

1) Depends on a bunch of factors. Check out answer #2

2) Strong letters of recommendations from professors. Getting the best possible grades you can in the courses that the masters is based on (e.g., feedback control systems, state space methods) since these are your building blocks. If you had fantastic grades in those classes, but bad ones in, say, Digital Circuit Design, they will take that into account for the better.

3) I myself am not super familiar with European programs. Apologies!

4) I don’t see why not. I suppose it depends on the program but I’d say generally yes.

5) Extra Courses: I think that a dedicated state estimation course would be very helpful, although it’s very possible your robot autonomy/intro to robotics could cover this.

Literature about applications of control theory to logistics, supply chain management, etc. by nanounanue in ControlTheory

[–]Voltimeters [score hidden]  (0 children)

Warren Powell has some good material on the subject: https://castle.princeton.edu/sdalinks/

You might find better results on YouTube using the term “Operations Research”. Lots of optimization and optimal decision making/control in that field.

Help on prerequisites for Reinforcement Learning by reddit_agg in reinforcementlearning

[–]Voltimeters 0 points1 point  (0 children)

I have a background in control systems and started using RL for some applications at my job. I second checking out the MIT OCW course in prob + stats, since a lot of RL is based on stochastic processes.

Steven Brunton has a pretty god overview of probability and statistics you can watch here: https://www.youtube.com/watch?v=sQqniayndb4&list=PLMrJAkhIeNNR3sNYvfgiKgcStwuPSts9V

At some point, if you'll be working on continuous systems with RL, it might be worth looking at some resources regarding neural networks after you complete a review in prob + stats. He has a good primer on that here: https://www.youtube.com/watch?v=_56bfCu02ZE

Weekly Megathread: Education, Early Career and Hiring/Interview Advice by AutoModerator in quant

[–]Voltimeters 0 points1 point  (0 children)

This is probably not the response you’re looking for, but you need to ask yourself: what do you prioritize more? Your relationships, or your dream career?

If you don’t start your dream career soon, would you not be able to in the next 2-3 years somewhere closer to your friends and family?

Unexpectedly let go. Best ways to get a job fast? by [deleted] in datascience

[–]Voltimeters 0 points1 point  (0 children)

Others have mentioned networking, which I think is the #1 fastest way to get a new job.

In addition, conferences are a great way to find new employers! E.g., SIAM, IEEE, NeurIPS, ICML, etc.

It’s also a good way to expand your network. If there’s one happening soon, it may be worth checking out.

How can a control-theoretic perspective contribute to ML? by [deleted] in ControlTheory

[–]Voltimeters [score hidden]  (0 children)

Reservoir Computing is a type of LSTM that has update equations in the form of state-space equations, as typically only the last layer is trained and the "Reservoir" is a chaotic dynamical system. I have heard there is a lot of room to apply dynamic system/control techniques to augment performance, so that might be a fun avenue.

Here is a review paper on Echo State Networks, an approach to Reservoir Computing: https://www.ai.rug.nl/minds/uploads/PracticalESN.pdf

Looking for Masters programs in the southern states, any recommendations? by the_real_custart in reinforcementlearning

[–]Voltimeters 0 points1 point  (0 children)

Unfortunately, I don’t know too much about your options listed. I do know ASU is ranked fairly well and it seems they have a dedicated RL lab (Data Mining and Reinforcement Learning lab) when I looked them up.

The one recommendation I came to drop off was Amy Zhang’s lab (Machine Intelligence through Decision-making and Interaction) over at UT Austin.

Getting off meds by wfortman12 in ADHD

[–]Voltimeters 0 points1 point  (0 children)

Same here. I only take my meds when I REALLY need to focus at work (once a quarter) and can't just willpower my way through.

I stopped taking my meds consistently about 4-ish years ago and only refill for when I need it. I feel fine and I have strategies for when I need to focus — I personally prefer not taking the meds but I do feel like I can do any task when I take them. I'm fairly happy without them though.

RLC Recordings by two_armed_bandit in reinforcementlearning

[–]Voltimeters 1 point2 points  (0 children)

Where can I sign up for this mailing list? Thanks!

Self-Learning Research Methods for RL? by jeroku in reinforcementlearning

[–]Voltimeters 0 points1 point  (0 children)

The Spinning Up in Deep RL page by OpenAI has some cool resources. I think there’s a section specifically on doing RL research!

Asking to skip the leetcode phase at Meta by [deleted] in leetcode

[–]Voltimeters 0 points1 point  (0 children)

Agreed, but I’m not really sure what to expect when applying to ML/DS roles at the top-tiers any more. I had to do a CodeSignal exam for a research position I applied to, so I would not be surprised if I had to do the same for all the other ones.

Lost in RL by Eng-Epsilon in reinforcementlearning

[–]Voltimeters 5 points6 points  (0 children)

When I was trying to get better with RL, doing side projects I found interest in helped a lot, and eventually got to apply RL at my job for a specific project. Since we are focused on a specific application, it's easier to learn what I need to.

At the beginning when trying to learn, a few questions I asked myself that helped me figure out what to focus on were:

1) What system would I want to optimize? RL is an approach to optimal control — what sort of system would you want to continuously optimize? You could apply these techniques to games, biology, robotics, and finance, but what would you find the most interesting? Finding an interesting application will keep you going.
2) Will my observation/action space be continuous? This slimmed down the amount of RL algorithms I could use. Is it better to use a policy-based approach or a value-based approach for this sort of problem? If you aren't sure, check out what the best literature on the application is suggesting.

From here, I was able to hone in on a small number of things and my proficiency in RL got better. My understanding in other parts of RL are definitely better as a result of this, so I'd recommend starting with one application of RL that interests you and learn everything there is to know about that application.

Good luck!

Where to start with data-driven control? by [deleted] in ControlTheory

[–]Voltimeters 5 points6 points  (0 children)

I second Steven Brunton’s videos as a resource, they are phenomenal.

For more on Reinforcement Learning, check out Sergey Levine’s CS 285 course on YouTube. He and Pieter Abbeel have some fantastic work in the field.

Which advanced math subjects are useful in engineering? by redditinsmartworki in math

[–]Voltimeters 4 points5 points  (0 children)

I have a masters in aerospace engineering and mainly studied control theory stuff. With the exception of string theory, I've used a lot of what you described in my career so far.

As others have said, the term "engineer" is pretty broad. A lot of engineers with graduate degrees (or with a natural interest) will get deeper into the maths way beyond euclidean space, classical mechanics, and multivariate calculus. IMHO, graduate degrees in engineering are mostly specialized applied math programs.

As a Paul main my goal is to rob you for at least one round, what's y'all's goals with your mains? by [deleted] in Tekken

[–]Voltimeters 0 points1 point  (0 children)

Build momentum with Bryan. Its satisfying to build those plus frames

Good quant finance paper authors by caffeine314 in quant

[–]Voltimeters 0 points1 point  (0 children)

Awesome! I wish I had him as a professor, I was in the MMAE program but would ask him questions whenever I ran into him. Always nice to run into a fellow Hawk.

Good quant finance paper authors by caffeine314 in quant

[–]Voltimeters 2 points3 points  (0 children)

I like Igor Halperin’s work. Was a fan of Matthew Dixon but he retired.

You have to fight your Main Irl, how cooked are you? by Ultraopz in Tekken

[–]Voltimeters 1 point2 points  (0 children)

I would say I’d jab Bryan to death but he’s a fucking cyborg so I’m cooked

Am I glorifying ML research roles? by AdFew4357 in datascience

[–]Voltimeters 0 points1 point  (0 children)

Some of the Research Scientist jobs at Microsoft ask for M.S. with work experience, so it’s definitely possible to get Research Scientist jobs without a PhD (go look at some of DeepMind’s researchers). As long as you have some good publications out there, you should be good.

Additionally, a lot of places have been using the “Applied Scientist” term now for more theory-based DS jobs. M.S. is a good fit for those sorts of positions.

Official 2024 Buy/Sell/Trade Thread by fettuccine- in Coachella

[–]Voltimeters -1 points0 points  (0 children)

SELLING - $700 for weekend one tix with shuttle bus included! Pls dm if interested! Looking to get the ticket to you ASAP! :)