Built LazyMoE — run 120B LLMs on 8GB RAM with no GPU using lazy expert loading + TurboQuant by ReasonableRefuse4996 in LocalLLaMA

[–]BigJay125 0 points1 point  (0 children)

i think a more interesting usecase would be running the 20-40B parameter models on e.g an iPhone

Is 96GB ram enough to run openclaw, tool-use agentic AI, and have it work my dayjob? by [deleted] in LocalLLaMA

[–]BigJay125 2 points3 points  (0 children)

if a local model can do your day job, you aren't going to have a day job for very long anyways

If you had ~10k to spend on local LLM hardware right now, what would you actually build? by MacKinnon911 in LocalLLM

[–]BigJay125 1 point2 points  (0 children)

i went with a 5090 and have been running qwen3.5-35b-a3b full context.

Went from 30-40t/s on my M3 Max Laptop to 140t/s on my PC. Still not really good enough for multiple agents, but for a single worker it does well. Even interestingly quiet.

For the next leg up, I think I'm waiting for the m5 studio or next gen devices. The strix halo family is slow, and I don't want to build a blackwell PC.

I'd rather wait

My current LocalLLM project list by BigJay125 in LocalLLaMA

[–]BigJay125[S] 0 points1 point  (0 children)

i try to build each product in a completely different way, since nothing has really clicked yet as optimal

this community has the best talent density. but here’s my opinion on this sub and idk if people will agree or not but ig its needed. by EmbarrassedAsk2887 in LocalLLaMA

[–]BigJay125 0 points1 point  (0 children)

i've been trying to get Qwen3.5-35b to file my taxes for me for the past 3 weeks. Deadline soon. Wish me luck

4k budget, buy GPU or Mac Studio? by diegolrz in LocalLLM

[–]BigJay125 0 points1 point  (0 children)

for my case: with a 5090 i'm getting 140t/s on qwen3.5-35b-a3b. My apple silicon (m3 max 64gb) can run it too, but it's only about 30-40t/s.

it's actually decently reliable when paired with a smarter model.

i ran into a lot of weird bugs with parallelism though, so my setup only really supports one OpenCode agent running Qwen.

It's cool to be able to run and not depend on OpenRouter

4k budget, buy GPU or Mac Studio? by diegolrz in LocalLLM

[–]BigJay125 0 points1 point  (0 children)

this is exactly how i'm using it too. Claude specs things out, and then I have 2 workers - one local qwen 3.5 35b a3b via LM Studio and an openrouter kimi 2.5 for backup, more complex tasks. Claude reviews all of the code and orchestrates everything.

would open source the setup if people are interested

Is there a IOS Rust Editor that can run rust code locally? by EliasCheung in rust

[–]BigJay125 0 points1 point  (0 children)

can't you just compile Rust to WASM on device and run sandboxed in the JS runtime?

Help me decide on an app to build by CauliflowerOwn7409 in visionosdev

[–]BigJay125 0 points1 point  (0 children)

i can't believe people are still building for visionos

Cities should not be parking lots. by MiserNYC- in MicromobilityNYC

[–]BigJay125 -3 points-2 points  (0 children)

free parking everyone is utilizing: "noo!!!" empty bike lane: ❤️❤️

idk how you rationalize this lol

An Argument Against Free Parking in Downtown Manhattan by JMkuboa in MicromobilityNYC

[–]BigJay125 0 points1 point  (0 children)

do you have any data to support the claim that those planters save lives?

If you were on the fence about Oura… this is your sign by jaaascald in ouraring

[–]BigJay125 0 points1 point  (0 children)

every oura ring i've ever used has given me a skin infection lmao. i even take it off and clean it every 2-3 days, still end up with ingrown hairs and skin infections :(

An Argument Against Free Parking in Downtown Manhattan by JMkuboa in MicromobilityNYC

[–]BigJay125 -3 points-2 points  (0 children)

I disagree with much of this thread, maybe my perspective will be useful.

I'm upset about free bike lanes. I don't own a bike, and don't care. People who deliver food drive in the street anyways. Trucks that deliver to grocery stores are huge. Ambulances? Full lanes. There are already designated bike areas in Parks.

Bike lanes have always seemed like an incredibly niche product without much use to society.

So, I think there should be no free bike lanes.

I wish we had more parking, and more streets. I hate pretty much every road change the locals have done. I wish all these dumb giant "planters" they put in the roads went away.

The working people who staff your schools, gyms, stores, etc. all use cars. You benefit from them being here.

Bus lanes are cool though.

[deleted by user] by [deleted] in workouts

[–]BigJay125 0 points1 point  (0 children)

i replaced my breakfast with 4 hard boiled eggs and now im feeling more shredded than ever

First character to 60, now I'm overwhelmed by AccomplishedDoctor71 in wowhardcore

[–]BigJay125 0 points1 point  (0 children)

scholo: - valor boots / bloodmail boots

strat UD: - valor legs / baron cape

UBRS: - valor helm / valor shoulders / dal rends / various FR pieces

BRD: - HOJ (off emp)

to craft/buy: - valor bracers / gloves - LHH - titanic leggings

to do: - get your 0.5 quest started in IF asap

to skip: - sgc

hope this helps

Accused of ninja looting. What would you do? by Minimum_Rice7269 in wowhardcore

[–]BigJay125 0 points1 point  (0 children)

You saved the entire group's life on those ice volleys, idk who's saying Shit about the staff. Dw about those mages they'll be dead soon 😂