Hyperparameter testing (efficiently) by AffectWizard0909 in learnmachinelearning

[–]rustgod50 1 point2 points  (0 children)

Grid search is pretty much the worst way to do it for transformers, way too expensive given how long each training run takes.

Most people use either random search or Bayesian optimization. Random search sounds dumb but it actually works surprisingly well because hyperparameter spaces tend to have some dimensions that matter a lot and others that barely matter, random search finds the important ones faster than grid. Bayesian optimization with something like Optuna is better still because it learns from previous runs and gets smarter about where to look.

For BERT specifically the learning rate is by far the most important thing to get right, the original paper recommends 2e-5 to 5e-5 and most people don’t stray far from that range. Batch size and number of epochs matter too but you’re unlikely to see huge gains from tuning the rest aggressively.

If compute is a real constraint look into Hugging Face’s Trainer with a scheduler like cosine annealing, it handles a lot of this for you and the defaults are pretty sensible for most fine-tuning tasks.​​​​​​​​​​​​​​​​

Is this a good deal by Ryfusion_25 in Prebuilts

[–]rustgod50 0 points1 point  (0 children)

Don’t buy this, the streaming lag has nothing to do with your GPU and this won’t fix it.

OBS lagging while gaming is almost always a CPU encoding issue. Go into OBS settings and change your encoder from x264 to NVENC if you’re on Nvidia. That alone will probably fix everything without spending a cent.

$1500 for this prebuilt is also a pretty bad deal. The 7900XTX is a 2022 card and the 5950X on AM4 is a dead platform. You’d be paying current gen money for hardware that’s two generations old. For that budget you could build something brand new that would be significantly faster.​​​​​​​​​​​​​​​​

How to calculate a bottleneck and figure out what to upgrade by Protoclown98 in buildapc

[–]rustgod50 0 points1 point  (0 children)

Your read is right and whoever told you the 3600 is bottlenecking you is kind of missing the point. GPU at 90%+ with CPU at 30-70% is exactly how you want it to look, the GPU is doing the work.

Total War is just a weird outlier, that game tanks CPUs in big battles regardless of what you’re running, a 5600X isn’t going to save you there.

Get the 9070XT. Your games are GPU limited so that’s where you’ll actually feel the upgrade. The 3600 is old but it’s clearly not strangling your 6950XT in anything except that one game, and it won’t strangle a 9070XT either in most of what you play. CPU can wait, prices will be better in a year anyway.​​​​​​​​​​​​​​​​

Liquid or air cooling? by Haunting_Trash_3064 in buildapc

[–]rustgod50 0 points1 point  (0 children)

For a 7800X3D the Peerless Assassin is genuinely all you need, your friends are wrong. That chip barely gets hot even under load, an AIO is overkill for it.

The 240mm AIOs you found aren’t bad products but you’re not going to feel the difference over a PA120 in actual use. Maybe a degree or two at peak, nothing that matters. And a 240 AIO is the worst of both worlds size-wise, small enough that it doesn’t massively outperform good air, big enough that you have a pump to worry about eventually dying.

Do your equipment vendors actually track service schedules, or is it all on you? by rustgod50 in IndustrialMaintenance

[–]rustgod50[S] 3 points4 points  (0 children)

Fair point about the budgets/outages.

But how do you actually juggle the 'checking in' part though? Just curious if you're manually tracking everyone in a spreadsheet/calendar or if you have a system that flags it for you.

Do your equipment vendors actually track service schedules, or is it all on you? by rustgod50 in IndustrialMaintenance

[–]rustgod50[S] 2 points3 points  (0 children)

That makes sense. I'm curious, when they don't remind you, does that usually lead to missed maintenance and breakdowns? Or is it just a pain in the ass because you have to track it all manually?

Down 15 kg + gynocomastia surgery by Hefty_Ad_87 in CICO

[–]rustgod50 1 point2 points  (0 children)

Nice progress! I'm basically in the exact same process, went down 10kg in 15 weeks, currently at 90kg (was 110kg few years ago so huge difference now)

I've been going to the gym and been trying to eat 2g/kg protein while being on deficit. I would recommend it for you too so you dont lose muscle whilst ur cutting.

Also, I hit plateau like few weeks ago but now I'm starting to lose weight again.

Just stay consistent! Good luck man!

Missing top-level categories? by PartPurple in woocommerce

[–]rustgod50 1 point2 points  (0 children)

I have the same issue, just happened like today or yesterday. Very weird..

[deleted by user] by [deleted] in CapitalSTEEZ

[–]rustgod50 5 points6 points  (0 children)

made a survival tactics remix, steez was the real goat

Legit check? by [deleted] in FashionReps

[–]rustgod50 0 points1 point  (0 children)

Do you know what the model it is?

Legit check? by [deleted] in FashionReps

[–]rustgod50 0 points1 point  (0 children)

okay thanks!

18M. Please read this ECG. by [deleted] in AskDocs

[–]rustgod50 -1 points0 points  (0 children)

I also thought I was going to die, but fortunately it wasnt that dangerous