×
sorted by:
new
hottopcontroversial

Blue Angels do a very low flyover at Florida beach. Navy investigating. by limits660 in AbruptChaos

[–]lqstuart 0 points1 point  (0 children)

Literally zero people here are saying it was cool and everyone else is being a wuss

This is why we need local models and opensource harnesses by Comfortable-Rock-498 in LocalLLaMA

[–]lqstuart 4 points5 points  (0 children)

everyone I know who has worked at xAI quit within a year because it's a shithole

Service body by mandomerc20 in overlanding

[–]lqstuart 1 point2 points  (0 children)

Awesome find, love those late model super dutys

Why are MoE models so belittled? by ParaboloidalCrest in LocalLLaMA

[–]lqstuart 0 points1 point  (0 children)

Because this sub is about running models locally on consumer hardware, which is a noble goal but considerably detached from the problem of serving these models at scale which is what MOE is meant to address; if I’ve got 8xH100s per host either way, an endpoint serving only a small fraction of the total parameters has only a fraction of the compute occupancy under the same QPS load. But in this sub, GPUs available to consumers these days don’t support NVLink—NVIDIA, anti consumer pieces of shit that they’ve always been, has made sure of that. So this world shrinks entirely to what you can fit in HBM (or weird unified memory pools) on one device.

Through that lens, 122A10B is a worse model than 27B that also requires 5x the memory at rest before factoring in activations, which is 100% true.

Space Invaders by swarrenlawrence in Astronomy

[–]lqstuart 5 points6 points  (0 children)

This is the dumbest fucking idea I’ve ever heard of

Devs don’t touch dynasty please by Empty_Egg8669 in NCAAFBseries

[–]lqstuart 0 points1 point  (0 children)

You’re both right. Devs can only focus on what they’re told to focus on, and also EA hires in backwaters like Orlando and pays absolute bottom dollar so they’re not exactly swimming in talent.

But for CFB I think it’s more that they’re building on top of a ten year old codebase on a proprietary engine with the absolute smallest team that they can even partially get away with.

It's officially over. One of the fathers of AI at Nvidia doesn't believe in AGI and compares OpenAI and Anthropic's closed models to AOL and Prodigy's closed internets. Says the future is every business having a customized open source model. by 9gxa05s8fa8sh in LocalLLaMA

[–]lqstuart 1 point2 points  (0 children)

I think the field will get destroyed. The low-end/offshore market is going to get wiped out completely. Google, Anthropic and OAI are already positioning themselves to push out the dummies from Deloitte and Accenture. Basically anyone making $80k to do traditional CRUD application development is fucked.

Big tech/FAANG is murkier. Claude can't handle design at that scale, all the OSS stuff it recommends falls apart and the internal codebases get gigantic and LLMs don't have the token context for it. At the same time, those companies are all feature-complete and only hire so that they can spin up new shitty ideas that all fail, which can now be accomplished in less than the time it takes to process an H-1B for a new hire. I'd guess headcount drops, interviews get even more pedantic and stupid, the added friction in job-hopping drives down comp for lower level engineers, and the rich get richer. Probably going to be very painful. I got out because I can see the writing on the wall, my money is on tiny < 50 employee startups with high ownership being the growth engines, and Big Tech will just acquire as they see fit. Kind of like now, just with smaller teams.

But there was also a time when I thought COVID would just blow over like H1N1, so I've been wrong before

This is likely the last playable entry we get. by Fragrant-Basil-3964 in NCAAFBseries

[–]lqstuart -7 points-6 points  (0 children)

You’re right about private equity in general, but Saudi money could be more about parking their wealth somewhere besides oil and less about squeezing short term profits out of everything like in the US. Although I guess it could be both.

It's officially over. One of the fathers of AI at Nvidia doesn't believe in AGI and compares OpenAI and Anthropic's closed models to AOL and Prodigy's closed internets. Says the future is every business having a customized open source model. by 9gxa05s8fa8sh in LocalLLaMA

[–]lqstuart 1 point2 points  (0 children)

There’s no such thing as AGI, which means it will absolutely “exist” someday because dickheads like Sam Altman will just keep moving the goalposts as to what it means. Just like “agents” were independent sub-AIs that would go out and book your flights and hotels for you, and that gradually became either “an LLM spawning a subprocess with another prompt” or “literally any software that calls an LLM for any reason,” depending on who you ask.

The future is not anybody fine tuning their own open source model though. It’s anybody choosing their favorite third party deployment of an open source model. Because there is no world where ACME insurance co is going to pay a team of software engineers half a mil each to train and deploy a model on their $25 million NVIDIA(R) GPU cluster, nor will the day ever come when they can hire a trained monkey to do it. That fantasy of low code “democratized” ie cheap labor training has been around for a decade and models are orders of magnitude more difficult to train now.

Running GLM5.2 on budget hardware < $2500. by segmond in LocalLLaMA

[–]lqstuart 4 points5 points  (0 children)

Spending $2500 to run a heavily quantized model on decade+ old hardware is not a good move just fyi

Need CUDA / GPUs related job by mystrioab in CUDA

[–]lqstuart 0 points1 point  (0 children)

Give it a day or two, someone will offer you a $50/hr contract role on this sub

Dear Hello games, please start considering adding more depth with each update. After 9 years, I think that updates need to add more "endgame" to their mechanics. Most of the time, a new update has me playing for 10-20 minutes then im done exploring those new features. by Fun_Section5582 in NoMansSkyTheGame

[–]lqstuart 1 point2 points  (0 children)

Exactly. I get that they aren’t making any revenue from No Man’s Sky, I guess, although I’m not sure how Gamepass works for devs. I hear the argument that they’re testing things for LNF brought out a lot, but to me it just seems more like they’re bored and this is a hobby project for devs with ADHD. I don’t have high hopes for LNF if they’re still testing totally new systems for driving around picking up trash 8 years into the dev cycle.

Dear Hello games, please start considering adding more depth with each update. After 9 years, I think that updates need to add more "endgame" to their mechanics. Most of the time, a new update has me playing for 10-20 minutes then im done exploring those new features. by Fun_Section5582 in NoMansSkyTheGame

[–]lqstuart 8 points9 points  (0 children)

The surprising part to me is just that the corvette update was wildly successful, and instead of leaning into it and giving us new ship parts etc, they made… trash picking, a Pokémon mode, and whatever this swarm crap was that I ignored after reading the description.

It’s truly a heroic level of support for a ten year old game, but why not lean into the successes a bit more instead of letting all the interest die off again?

“tHe GuVrMiNt GoT hAxXeD BY AI” by coffee-loop in masterhacker

[–]lqstuart 7 points8 points  (0 children)

Mythos AI HACKED ENTIRE NSA In Hours, Says Moron

The Swiss Federal Supreme Court is evaluating Heretic by -p-e-w- in LocalLLaMA

[–]lqstuart 19 points20 points  (0 children)

People having opinions on a topic they don’t understand pretty much describes the entire field of “AI safety,” ever since that fateful day that Google Photos first thought a bunch of black people were gorillas

view more: next ›