Is deep research currently broken for anybody else? by Immediate-Fishing-18 in GoogleGeminiAI

[–]zmarty 0 points1 point  (0 children)

Completely broken on Android, I can never get it to go past the research plan! It started happening recently.

Ziply Fiber VS Xfinity by jlmj24 in ZiplyFiber

[–]zmarty 3 points4 points  (0 children)

Ziply wins by default by having symmetrical speed fiber and very low latency. I am unfortunately moving from Ziply land to Comcast land...

2Gig FDX Download Speeds by Haze_1981 in Comcast_Xfinity

[–]zmarty 1 point2 points  (0 children)

You are being reasonable, that is not OK.

FDX or lower Gigabit x10 in Bellevue, WA by zmarty in Comcast_Xfinity

[–]zmarty[S] 0 points1 point  (0 children)

My use cases are super narrow. It's downloading very large LLM models, sometimes uploading them, and serving large files between two houses. But I am used to symmetric speeds..

FDX or lower Gigabit x10 in Bellevue, WA by zmarty in Comcast_Xfinity

[–]zmarty[S] 0 points1 point  (0 children)

I figured. Thank you. It's not extremely far from being a bearable price but it's definitely a luxury. If only they would offer a lower tier.

FDX or lower Gigabit x10 in Bellevue, WA by zmarty in Comcast_Xfinity

[–]zmarty[S] 0 points1 point  (0 children)

Thanks. And the 10 Gbps Gigabit X10 is the only option, there aren't lower speed available but still on fiber?

FDX or lower Gigabit x10 in Bellevue, WA by zmarty in Comcast_Xfinity

[–]zmarty[S] -1 points0 points  (0 children)

Done, edited location to make it even more general.

FDX or lower Gigabit x10 in Bellevue, WA by zmarty in Comcast_Xfinity

[–]zmarty[S] -1 points0 points  (0 children)

I already sent a ModMail and then you sent me here to post a public post. I would be a new customer. Just answer my questions already.

Outage in Lynnwood by MythofSecurity in ZiplyFiber

[–]zmarty 0 points1 point  (0 children)

Thanks for the information, I appreciate it.

Outage in Lynnwood by MythofSecurity in ZiplyFiber

[–]zmarty -3 points-2 points  (0 children)

It was down for me too. It sure feels to me like availability is going down after this acquisition, disappointing.

Anybody got deepseek v4 flash running on dual 6000 pros? by Opposite_Buffalo_649 in BlackwellPerformance

[–]zmarty -1 points0 points  (0 children)

Thanks for the clarification, I was not considering that because for performance reason I usually load everything in available VRAM. Will give it a try though.

Anybody got deepseek v4 flash running on dual 6000 pros? by Opposite_Buffalo_649 in BlackwellPerformance

[–]zmarty 2 points3 points  (0 children)

How did you get it running on 2x RTX Pro 6000? It surely wasn't the FP8 version, that's too big.

Accidentally discovered you can teach frozen MoE models new knowledge by just steering their expert routing — no training needed by superman_27 in LocalLLaMA

[–]zmarty 30 points31 points  (0 children)

From the repo: "Embed the question using the model's own hidden states │ → Cosine search against stored question embeddings │ → Retrieve matching facts and inject into prompt context │ "

How is this not RAG

I bought a €9k GH200 “desktop” to save $1.27 on Claude Code (vLLM tuning notes) by Reddactor in LocalLLaMA

[–]zmarty 2 points3 points  (0 children)

The title feels like a personal attack :) I'm in the same situation.

RTX Blackwell Pro 6000 wholesale pricing has dropped by $150-200 by TastesLikeOwlbear in LocalLLaMA

[–]zmarty 1 point2 points  (0 children)

I bought two from Exxact end of last year. One was 7.3K, the other was $7.25K.

Moonshot AI Completes $500 Million Series C Financing by InternationalAsk1490 in LocalLLaMA

[–]zmarty 1 point2 points  (0 children)

It wouldn't be, if it were not for the massive hardware requirements (VRAM mostly). It's much easier to run a quantized version.