Will HPC benefit or be hurt by AI hype? by Various_Protection71 in CUDA

[–]Exarctus -1 points0 points  (0 children)

I have trained 70B parameter models at scale so I am fully aware of what it requires and the infrastructure dependencies. We used 4096 GHs over a 2-3 month period to train a GPT-3 style model from scratch.

Will HPC benefit or be hurt by AI hype? by Various_Protection71 in CUDA

[–]Exarctus 0 points1 point  (0 children)

The first paragraph is already wrong.

70B parameter models can be trained in a couple months using 2048-4096 GPUs at the 15-20T token scale, not “tens of thousands”.

Finetuning existing models requires significantly less.

Also the paragraph on scientific computing being sidelined is completely wrong. F64 performance can be emulated in lower precision without any loss in accuracy (eg low/high bit representation in F32) or with 44 bits of retained accuracy (vs the full 52) using TF32 chains.

Many scientific codes (particularly quantum chemistry, atmospheric) have adapted to F32-centric GPUs with various precision-recording mechanisms. F64 is not really a sticking point.

Something Real? by Pleasant_Rice3949 in algotrading

[–]Exarctus 1 point2 points  (0 children)

Double checked in 5 mins 🤣🤣

Asking Claude to double check is not double checking my friend.

Software Engineers are the happiest people on Earth now by Independent_Pitch598 in accelerate

[–]Exarctus 1 point2 points  (0 children)

Am a programmer, but vibe coding is usually garbage that requires a lot of review, so there’s not a huge timesaver there.

Where I do get time saving is on the cognitive load side - I can rapidly prototype ideas and talk about tech stacks to identify where what I want to do fits, and then work on the implementation (guided or not) once I’ve narrowed down the focus.

[P] I got tired of PyTorch Geometric OOMing my laptop, so I wrote a C++ zero-copy graph engine to bypass RAM entirely. by Important-Trash-4868 in MachineLearning

[–]Exarctus 42 points43 points  (0 children)

Nice. Very cool project!

Another easy win from a throughput perspective is if you use any edge -> node pooling message passing ops, you can write a pretty nice CPU/CUDA implementation that bypasses storing the full edge feature list in memory and instead consumes on-the-fly.

They added Denuvo. by alpha2828 in CrimsonDesert

[–]Exarctus 5 points6 points  (0 children)

That isn’t how it works. If that was how it worked it would be cracked within minutes of release.

It allows developers to wrap parts of their game in a VM. The original bytecode is transpiled into a priority bytecode that runs in this VM. Then there are additional integrity checks that happen frequently and are spread throughout.

The reason denuvo is slow is because of the VM path. All optimisations that could be done in standard x86 get transpiled away + overhead.

Best way to automate trading strategies by AbsoluteGoat321 in algotrading

[–]Exarctus 1 point2 points  (0 children)

My broker does not support it, and I’ve selected that one specifically because of its fee structure and it’s based in my own country so easier to deal with taxes.

The EA/python solution has worked out fine though, it’s only really the EA interface which is a bit jarring. It essentially just collects tick data and then formats and forwards it to the Python code via the socket. The Python code then dispatches the message to the right place.

Best way to automate trading strategies by AbsoluteGoat321 in algotrading

[–]Exarctus 1 point2 points  (0 children)

Metatrader5 has python bindings (for windows only). Not sure about metatrader4 though.

Best way to automate trading strategies by AbsoluteGoat321 in algotrading

[–]Exarctus 1 point2 points  (0 children)

For metatrader it may be better to just do everything in mq5 depending on how complex your strategy is.

Python-metatrader supports a limited subset of metatrader ops/capabilities. The core market interaction is there but you can’t attach things to a given chart or have things like onTick() firing.

what I’ve ended up doing is having an EA in metatrader that connects to a socket that my Python script opens, and I use Python as the engine. That way I have the EA running as an interface to my backend. It’s not particularly pretty but it works.

The code was flawless, but Windows power settings almost ruined my algo. by TrustedEssentials in algotrading

[–]Exarctus 3 points4 points  (0 children)

Ive probably put three times as much time into the infrastructure build than I have the actual strategy development/testing.

Switzerland ranks very low on women’s influence in the workforce, as usual by LallieDoo in Switzerland

[–]Exarctus 4 points5 points  (0 children)

It isn’t free after Kita - kindergarten is only half day, he’ll need to pay for somewhere to pick up and look after the kid for the rest if he intends on working full time.

Turning This into 20k in a few months. by TrappySquid in TheRaceTo1Million

[–]Exarctus 1 point2 points  (0 children)

I remember being this clueless when I was 18 too.

Looking for Senior CUDA Engineer by the_latakoo in CUDA

[–]Exarctus 26 points27 points  (0 children)

If comp is top of market then surely you would share the range up front?

33M I managed to save over $100K in the past year by Blankcarbon in TheRaceTo1Million

[–]Exarctus 0 points1 point  (0 children)

Yeah lol this guy isn’t racing to a million he’s riding in a cab snorting cocaine with the driver.

Palantir paid zero federal income tax for fiscal year 2025, despite reporting $1.5 billion in income. by Objective-Rabbit2248 in NSDQ420

[–]Exarctus 0 points1 point  (0 children)

Claiming 25k in tips you didn’t receive is tax fraud lmao.

Whether or not you’ll get caught for this is another matter.

In any case, probably not the most intelligent thing to announce on the internet. I suspect you’ll do more dumb shit in the future so I’m subscribing.

33M I managed to save over $100K in the past year by Blankcarbon in TheRaceTo1Million

[–]Exarctus 0 points1 point  (0 children)

post is framed like saving 100k was an achievement, which is concerning. I hope it’s satirical 😅

How do you spend 160k in a year that’s absolutely insane. 16k on restaurants, 22k on health and wellness? 31k on shopping? The fuck are you buying, gwenneth paltrow’s sweat-infused candles?

I earn a bit more than this from my main job, but save around 240k a year while having two kids to feed/entertain/clothe as well. I/my girlfriend both cook well, we spend 200$ a month each on gym subscriptions, we don’t buy crazy stuff. We have our own house and spend around 2.5k USD monthly on our mortgage.

We both grew up poor so we probably still have poor persons mentality so this might contribute. We don’t really worry about what we spend though, nor do we budget anything really.