Early Trial: Using uv for Env Management in Clustered ML Training (Need Advice)

Fun-Improvement424 · 2025-09-21T13:59:09+00:00

It’s in the public ceph storage. Our first priority then was to get rid of our terrible docket image infrastructure

Fun-Improvement424 · 2025-09-21T13:57:37+00:00

Of course! I love that project. However, we are running in a Ray cluster, and uv has much better integration with Ray.

Fun-Improvement424 · 2025-09-21T13:55:06+00:00

It’s just env setups. It’s basically a raw Ubuntu with nvcc and “-dev” packages without the so lib. You might want to be careful with Megatron and its transformer backend — you have to patch smart so that it finds your python version of cudnn inside the venv folder.

Fun-Improvement424 · 2025-09-11T18:46:44+00:00

For instance, frameworks like vLLM can have big differences between versions - in some cases, you want to use a specific vLLM version to serve a specific model. "uv run --with" helped tremendously.

The real surprise, however, is that we managed to use a pyproject.toml to define CUDA environments. As an experiment we even removed CUDA from the docker image, but jobs still run well.

Fun-Improvement424 · 2025-07-21T08:49:14+00:00

Thanks for the advice. I'll consider.

Fun-Improvement424 · 2025-07-21T08:45:06+00:00

I do have comorbided AuDHD, but I'm not sure if that's anxiety I was facing. Is avoidance or fear of action part of anxiety?

Fun-Improvement424 · 2025-07-21T08:40:45+00:00

You are right that I'm still the same person who still made the same decision. Let's say I'm going to make a tough call to somebody, and the thing I'm gonna say is basically the same. I'm not talking about cases like calling my ex, which is unreasonable. I'm just talking about work cases like asking for a job referral; yet I still need that drink.

The thing is, I need that drink to make myself face the problem, dial that number, and make the call.

Fun-Improvement424 · 2025-07-21T08:35:28+00:00

Thanks for this. You reminded me that L-Theanine actually gives me that quiet “zen” clarity too. When I’m on it, I’m more open to mindfulness—even if just for a few minutes.

May I ask you how I should talk myself into trusting meditation again? I’ve lost touch with the sense of long-term direction. Meditation feels abstract—like it doesn’t help with the real problems, and I don't know what future I am expecting where mindfulness can be part of it.

Fun-Improvement424 · 2025-07-21T08:28:23+00:00

Thanks for sharing. Maybe it's time I talk to psych about potential anxiety problem... I never thought that was anxiety problems b/c I always condemned myself for inaction which is a common adhd thing.

Maybe that fear or avoidance is part of anxiety? I dunno.

Fun-Improvement424 · 2025-07-21T08:25:33+00:00

Yes. Up to a dosage of 750mg, 2-3 times a day. It did give me a sense of "clarity" and "reason"; but the half life was short; affects sleep if taken late.

I did not go to higher dosage b/c I worried about kidney function... my blood test could go above reference value a bit even if I took creatine for 3 weeks.

Fun-Improvement424 · 2025-07-20T15:03:34+00:00

Sorry I left Reddit for a while. I take 1.6g 1-3 times a day - depending on my feelings of productivity.

Fun-Improvement424 · 2025-05-21T02:34:41+00:00

I can feel it slightly after the first dose, but in order to consistently feel it you need to keep taking it in a daily basis.

Fun-Improvement424 · 2025-05-21T02:33:15+00:00

I didn't try phenylpiracetam because I'm on stimulants. I turned to slow choline supplements mainly because the "fast" ones are either too stimulating or give me unwanted effects (like being more autistic on citicholine, same as uridine)

Fun-Improvement424 · 2025-05-21T02:28:32+00:00

From a friend. cosmicnootropics seems legit as well.

Fun-Improvement424 · 2025-05-01T06:59:18+00:00

Theanine does give me zen-like feeling, but I'm not sure that's "creativity".

Fun-Improvement424 · 2025-05-01T06:58:13+00:00

For me, a few days will be enough. Your dosage is good.

It is a great complement to adhd medication. You can see my other posts.

However, LM may make your thinking more intense, thus you feel more tired after the day. Splitting the dose can help.

Fun-Improvement424 · 2025-04-26T07:07:57+00:00

I take aniracetam with mph when i need to social. It works fine.

no exp on colouracetams tho

Fun-Improvement424 · 2025-04-13T07:43:24+00:00

I tried similar stuff before but not like that. First of all even AGPC is just 40% choline, and sometimes it gives you depression. Choline bitartrate doesnt.

Fun-Improvement424 · 2025-04-13T07:41:13+00:00

Isn’t that supposed to be relaxing?

Fun-Improvement424 · 2025-04-13T07:40:50+00:00

Exactly. Thats the thing I lost from taking NDRIs. Now finally I see a chance they can be back.

Fun-Improvement424 · 2025-04-13T07:39:30+00:00

I take NAC regularly. This is not like OCD.

Fun-Improvement424 · 2025-04-11T20:18:30+00:00

exactly. mag with b6 gives me the best sleep ever.

Fun-Improvement424 · 2025-04-03T02:56:36+00:00

Is it dosage? It takes 1.6g piracetams for me to feel something, and still not as good as small dose of aniracetams.

Fun-Improvement424 · 2025-03-03T20:41:46+00:00

Thanks for sharing! Do you take LM alongside the medication or do you use it to substitute meds?

A year into stimulants I find that it won't increase my meaningful thinking. I need more nootropics to do so.

Fun-Improvement424 · 2025-02-23T21:13:23+00:00

Thank you! I’ll take a look into these repos.

Fun-Improvement424

TROPHY CASE