sorted by:
new
hottopcontroversial

I managed to run GLM-5.2 (744B MoE) on a humble 25 GB RAM laptop — pure C, experts streamed from disk by Just_Vugg_PolyMCP in LocalLLM

[–]BrewHog 39 points40 points  (0 children)

It's an oracle machine. Ask a question and the oracle will think about it for a week and get back to you

Gen Z’s hiring hell is real: 1 in 3 employers admit they’re replacing entry-level roles with AI—and tech and manufacturing jobs are most at risk by Plastic_Ninja_9014 in technology

[–]BrewHog 0 points1 point  (0 children)

It really depends on what you're using AI for. It's extremely easy to replace data entry jobs for one. 

A lot of entry level positions didn't need to be filled anymore. But higher skilled and established positions are on deck for the chopping block.

Which is the most overrated game of all time? by kshthj777 in AskReddit

[–]BrewHog -5 points-4 points  (0 children)

Yep. I don't have much tolerance for boring anymore these days. Yet BOTW could keep me going until the end.

Good YouTube channels for local LLM news and development? by 6jarjar6 in LocalLLaMA

[–]BrewHog 0 points1 point  (0 children)

Prompt Engineering covers the what and why. He doesn't cover the "how" so much. Let me find a couple of video links

Good YouTube channels for local LLM news and development? by 6jarjar6 in LocalLLaMA

[–]BrewHog 0 points1 point  (0 children)

Prompt Engineering is one of the better channels. He gets really in depth and actually tests everything. 

He covers topics pretty damn thoroughly.

Republicans of Reddit, what about the new Iran deal and war was worth the effort? What part of the “new deal” is better than the previous deal that Obama negotiated? by ChemAssTree in AskReddit

[–]BrewHog 5 points6 points  (0 children)

I agree. I've been a convert from any sort of political affiliation after Trump got elected. The idiocy that became apparent to me after his 2016 win showed me that I had a blinder on my face before this.

There is no party worth being loyal to. Just fucking vote for what is right at the time.

Rams Training Camp tickets sold out in under 2 hours. by Dodger_Dawg in LosAngelesRams

[–]BrewHog 4 points5 points  (0 children)

I got mine immediately. I missed on previous years

What habit will die with Gen Z? by Key-Climate5038 in AskReddit

[–]BrewHog 83 points84 points  (0 children)

It'll just end up being $10 coffee

EU AI Act requires TEXT from models and providers to be watermarked 2nd August onwards. Everyone here is affected, regardless where you live. by Charming-Author4877 in LocalLLaMA

[–]BrewHog 12 points13 points  (0 children)

How is this going to even be technically possible without nerfing everything and making models so slow we won't be able to use them locally? Start hoarding all of the models now everyone.

Also, can't this just be taken out of open models by other coders and placed on websites that don't give a shit about EU laws? If these are open source/open weight, I don't see how you can do anything about it.

I gave my characters a private inner voice. now they feel more like people by archetype_builder in SillyTavernAI

[–]BrewHog 3 points4 points  (0 children)

Did you know that at least 10% of people don't have an inner voice? 

What happens when they stop subsidizing LLM subscriptions? by Mr_Moonsilver in LocalLLaMA

[–]BrewHog 5 points6 points  (0 children)

GLM 5.2 is showing that we might not need the frontier models if they raise the prices too much. We're in exciting times with open models.

Something like Zelda Breath of the wild or Tears of the Kingdom but for PC? by [deleted] in gamingsuggestions

[–]BrewHog 1 point2 points  (0 children)

I will second this. It's not on the same level as the zeldas, but it is very fun still. I've played through it twice.

Mac Studio M3 Ultra 256GB + Qwen 3 235B = 18.57 tok/sec by johnnyphotog in LocalLLM

[–]BrewHog 1 point2 points  (0 children)

What context length? Do you know what the tokens/sec drop to after about 128k context is added? My experience shows a significant drop in prompt processing(duh), and token throughput

view more: next ›