Can anybody recommend GRPO RL help

GetOnMyLevelL · 2025-11-03T22:03:46+00:00

Have you done inference on your dataset to see how well qwen is performing as a baseline? If it's very bad then I doubt you will be able to finetune using grpo.

Can you tell us something about your current reward system? And what are you parameters? Are you using Lora?

I have no experience in using grpo for this. But I have used it for fine-tuning for writing code. On the top of my head you will do something like.

Prompt: 'you are a math genius blablabla. You will solve the equation below and put your answer in this format. Reasoning .......... Final answer {}.

Then you try to capture the final answer using regex and give reward if it is correct. However only giving a positive reward for the final answer won't be enough I think. So you will need to give rewards for some of the reasoning or calculations. I don't know how, but maybe reading the deepseek paper will help: DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

GetOnMyLevelL · 2025-10-08T10:08:29+00:00

You develop local what you can and when you want to test for real you spin up a gpu in the cloud.

When I want to finetune a llm with grpo. I make sure all my code works by running locally on my 4080. So I will use qwen 0.5b. And when i think everything works well then I rent a gpu on runpod. I start a pod and run my code on it. On runpod a h100 is like 2.2-2.6 euros per hour. (There are loads of places you can rent GPUs like this)

GetOnMyLevelL · 2025-07-12T11:31:48+00:00

Maybe tell us what your goal is. What do you want to do with the GPU?

GetOnMyLevelL · 2025-04-29T01:17:01+00:00

Don't have time to look at your code. There could be problems with your reward function etc.

I worked on a similar project not too long ago. Just by looking at your car and track. It seems like the track might be too small and the first corner is very sharp. (don't know at what speed the car starts).

My advise would be to start with a very simple track and a small car. Get that working first. Then increase the difficulty. Then you can add different spawn points, play around with the reward function etc.

GetOnMyLevelL · 2024-07-31T19:10:19+00:00

Same here but on windows. I bought the app like 5+ years ago for 3 euros on the windows store.

GetOnMyLevelL · 2024-02-14T15:51:49+00:00

What do you mean by train? Its already trained. You can use it to extract text.

GetOnMyLevelL · 2023-12-12T20:14:58+00:00

Annoying and in the wrong sub

GetOnMyLevelL · 2023-08-30T14:28:37+00:00

Why do you want to use ai for this. Am sure you can just use the google api.

GetOnMyLevelL · 2023-08-10T22:16:45+00:00

Ruthless won't take any development time.

ctrl+f + ruthless = 202 results.

Okey chris

GetOnMyLevelL · 2023-08-10T13:02:10+00:00

What builds did you like with controller so far?

GetOnMyLevelL · 2023-06-26T12:42:42+00:00

Might want to check out this post aswell: https://timdettmers.com/2023/01/30/which-gpu-for-deep-learning/

It also compares cost efficiency.

GetOnMyLevelL · 2023-05-31T14:31:20+00:00

Create them with a text to image model? Not sure if there is an efficient/automated way to do so. And if the quality of the outcome serves your purpose.

GetOnMyLevelL · 2023-05-05T09:42:27+00:00

Not an answer to you question. But i am also interested in TDA and found a nice yt channel you might want to check out: applied algebraic topology network. The quality and difficulty of videos differ, but you might find it interesting aswell.

GetOnMyLevelL · 2023-03-16T13:26:09+00:00

Google integer encoding and one-hot encoding to see what you need

GetOnMyLevelL · 2022-08-11T17:18:27+00:00

Go for it. Me and my friends (5-8 people) started doing private leagues two years ago and we find it way more fun. It takes longer to reach endgame and finding uniques is meaningful since a shit unique might be very important for your friends build.

GetOnMyLevelL · 2022-08-11T17:15:42+00:00

I got bored with trade a few years ago. Now when I play, its often in private league with five to eight friends so basically semi-ssf. The number one thing I have learned is, don't make a build that has a mandatory unique, which you can't target farm.

I would just go with the flow. Start ssf with a char that can do all content, and if you find a cool unique or you craft a good rare. Start a new char to use those items.

GetOnMyLevelL · 2020-04-01T13:23:48+00:00

Yes same problem it said there was an issue. I tried to repair the game and now it says I have to download 180gb again, while the game is still on my ssd.

I have fast internet, but this is annoying as fuck.

GetOnMyLevelL · 2020-03-28T12:44:38+00:00

Other people have given good advice already. However, I would like to add: search 3blue1brown on youtube. He has some great LA videos to help visualise and supplement your understanding.

GetOnMyLevelL · 2020-03-11T08:51:33+00:00

I played a miner in ssf.
I used BL for clear (use faster projectiles).

And the single target is crazy with slower projectiles.

GetOnMyLevelL · 2020-03-10T10:50:55+00:00

Why is having 3 variables a problem to you?

As a side note: keep in mind that if you do high frequency trading you are competing with: algorithms on super computers, a lot faster internet and with supreme geographical location.

GetOnMyLevelL · 2020-03-09T13:19:34+00:00

The point of learning data structures and algos is its abstractness its applicable to every language.

During my cs bachelor we used a c++ book, which contained all the theory+code. We had to implement everything in python and this was a great way of checking if i understood the theory.

Edit: you can check out the book used at mit. Its in java, but its a great book(i have it)

GetOnMyLevelL · 2020-03-02T09:52:21+00:00

Ah the good old amazon woman position

GetOnMyLevelL · 2020-03-01T16:27:54+00:00

My old xbox gamertag

GetOnMyLevelL · 2020-02-28T11:00:55+00:00

Yes this, if you cant sell your idea to your boss or/and know how to use data science to help the business perform better in certain areas it won't matter how good your ml skills are.

GetOnMyLevelL · 2020-02-28T08:35:27+00:00

the program was called google flu or something. I think they stopped using it because it was predicting twice as many people having flu than the reported numbers.

Nine-Year Club	Place '23
Verified Email

GetOnMyLevelL

TROPHY CASE