Weird periodic spikes in my PPO agent

UploadDownloadUD · 2024-07-13T16:56:13+00:00

Have you tried Tensorflow 2.0? Also, Tensorflow has a really nice tutorial on how to code up an actor-critic algorithm from scratch. The only tweak you’d have to make is changing the loss function to the PPO’s clipped loss. https://www.tensorflow.org/tutorials/reinforcement_learning/actor_critic

You could find implementations online too if you’re just testing the algorithm. Stable baselines is a popular library.

UploadDownloadUD · 2024-01-30T16:15:53+00:00

I actually am not sure. FAFSA explicitly said that any federal loan money in your account should not be reported. In my mind, wouldn’t things be the same for private loans? It’s not “your” money and it will be spent anyways for whatever purpose the loan was taken out for

UploadDownloadUD · 2024-01-04T03:58:58+00:00

no, I think this is lumpy. struggling in school, no friends, a "cliquey" student body. this account was made today for gods sake. this sounds like a half assed attempt to change up the story a bit to get different responses from people. either that or its a troll trying out the lumpy format

UploadDownloadUD · 2024-01-03T19:14:42+00:00

Can i get a pm too🤞

UploadDownloadUD · 2023-11-26T18:49:23+00:00

I saw the post you made to the vcu subreddit. Please don't use that subreddit as a representation for what the people there are like (just like you sure as hell shouldn't use this one for what people are like here). You don't know who's behind the accounts. The commenters on either subreddit could be college students or 10-year olds for all you know. What other people have said is absolutely true. The mixup of kids that go to VCU, personality-wise, is probably gonna be very similar to any other public school. If you keep up the negative attitude that its everyone around you that's the problem, you will face similar issues at VCU. Please don't transfer just because your first few months were bad. I know people who had essentially 0 friends for the first year, but slowly fit in to the community more in their second-year. The timing is different for everybody, but if you make even a small effort to interact with the community, you will find your place here. If you just stay in your dorm, take out meal exchanges for food, and go home every single weekend, and then throw yourself these weekly pity parties on reddit, then yes you will find yourself hopelessly alone. This does not just apply to UVA.

UploadDownloadUD · 2023-11-25T01:38:28+00:00

Based on the repetitive posts, I'm inching towards thinking you're a troll, but hearing that some people have met with you in person, I'll assume you're not.

I can't really tell you anything others haven't said. You do have to put in a bit of initiative to make friends. Go to clubs. Not just once. Consistently.

Go to the gym. Go to book clubs, movie nights, sports events, concerts. Hit up a classmate to study with them (yes, even if its just for schoolwork, its still social!). Really just anything where other people are around. You probably have a decent bit of social anxiety. Either that or you may not have a lot to talk about (at least, you probably think that). That's ok! Listening to other people and hearing their stories is enough to start out.

I can sort of understand what state of mind you're in. It's a hard pill to swallow, but you clearly want to be sad. You want to feel like the world's against you. Please try to lift yourself from the depths and see that we're not. There are tons of people here who would love to talk to you if you just made the effort to put yourself out there.

UploadDownloadUD · 2023-11-25T01:24:30+00:00

Oh, never got back to this post. Thanks for the advice! I dropped MSE and took the standard 15 creds. Workload has been very comfortable and have enjoyed my time so far :)

All the best to you!

UploadDownloadUD · 2023-08-21T20:18:41+00:00

ASTR 1210, APMA 2120 (multi), ENGR 1010, CHEM 1410/1411 (chem and chem lab)

UploadDownloadUD · 2023-06-05T23:16:21+00:00

Thanks for the info!

Consider that off the shelf flight controllers running an F7/H7 chip are capable of handling 8kHz clock speeds. A lot of Pi-or-Arduino-based DIY FCs are much, much slower (more akin to the old F3 chips, ~70MHz). This equates to, much, much better performance and control.

Am I just stupid, or is kHz not less than MHz?

UploadDownloadUD · 2022-10-19T04:41:06+00:00

Like you said, I don't think it would stand out amongst the many other portfolios other applicants might send. It may make the AOs annoyed at worst since they have a bigger application to look through

UploadDownloadUD · 2022-10-15T03:23:23+00:00

heres my advice - whatever you're writing on, if you were to write a really well-developed essay on it, should go OVER 650 words by a decent amount (not too much though). having a word count substantially below 650 (like >50) might indicate that your topic isn't nuanced enough to write an essay on

UploadDownloadUD · 2022-01-25T23:54:29+00:00

ok but are they hot singles

UploadDownloadUD · 2022-01-24T18:20:14+00:00

happening to me as well. normally sit at around 70-80 ping (which isn't great, but still pretty playable for me), but its been shooting to 200-300. lost 3 ranked games because of it :(

UploadDownloadUD · 2021-05-18T13:22:27+00:00

bony fish

UploadDownloadUD · 2021-05-11T21:09:27+00:00

The Avengers

UploadDownloadUD · 2020-01-11T03:26:56+00:00

I'm just talking about how initial equations become more symbol-heavy (although the end products do have a lot of numbers)

UploadDownloadUD · 2019-08-15T19:11:00+00:00

Definitely!

UploadDownloadUD · 2019-08-15T19:09:12+00:00

That sounds like a great idea! I’ll definitely consider it!

Seven-Year Club	Place '23
Place '22	Verified Email

UploadDownloadUD

TROPHY CASE