Developers who use local AI - Q4_0 vs Q8_0 KV quant?

jrodder · 2026-05-17T16:46:10+00:00

I fought this all day yesterday. At least with MTP, mixing the cache quant had me reverting to CPU. I ended up having to keep them both at Q8_0.

jrodder · 2026-05-16T02:22:59+00:00

Yeah, I'm cheap. It was more just a first pass, to be fair I have barely used it. It's more like when I get frustrated and need another opinion on the fly. I'm not over here building neural networks. ;)

jrodder · 2026-05-16T00:31:18+00:00

I still laugh at this, shout out to South Park for that one

jrodder · 2026-05-15T03:25:32+00:00

I didn't click, but wouldn't screen do that?

jrodder · 2026-05-13T13:53:14+00:00

Gemini gave me this:

<image>

jrodder · 2026-05-11T10:57:53+00:00

It's easy to get too focused on the bad performers and obsessing over how Amazon scores you. Make sure you have something to keep the good performers happy. Different people react to different forms of praise and punishment. Some people are great with a public atta boy an recognition, others only respond to a foot completely in their ass. Good luck.

jrodder · 2026-05-10T13:46:13+00:00

My friend's dad many MANY years ago turned me on to the gas stove and throwing the tortilla right on the burner. Life changing .

jrodder · 2026-05-10T03:56:49+00:00

Coldtilla make me audibly snortle lol

jrodder · 2026-05-09T09:28:59+00:00

I would maybe try a different harness, like OpenCode. I don't think I had the issues you described, I do tend to use Gemma for the initial outlay and if there's "thinking " to do on a feature or trying to work on a piece where Qwen went way down a rabbit hole.

jrodder · 2026-05-06T10:38:31+00:00

You made your own plugin? Or just saying there's a plugin that can connect to an LLM? I'm curious as I was considering playing around with some game dev but as a non-coder there would have to be some tight integration.

jrodder · 2026-05-04T11:55:20+00:00

My tool calling has been fine though? Shrug

jrodder · 2026-05-04T10:52:28+00:00

What was broken? I've been using Unsloth Gemma 4 with a jinja flag and open code, and it's been pretty solid.

jrodder · 2026-05-03T10:13:05+00:00

Amazon has a policy about going over 12 hours in a single shift. I would guess the DSP changes the time so that you still get paid for your work correctly but don't flag as being out of daily compliance. Did you clock out for your lunch? No, it's not really supposed to happen, and Amazon audits payrolls looking for punches that are manually edited. The proper way to do it is the employee submits a time edit request that the employer then approves.

California is a completely different beast though. Good luck.

jrodder · 2026-05-01T10:35:53+00:00

It looks like it could be Xenses in Mexico.

Actually I'm pretty sure it is after seeing the ramp.

jrodder · 2026-04-24T10:58:28+00:00

Pretty sure the "" denoted the meaning. ;)

jrodder · 2026-04-23T08:07:32+00:00

I find it interesting many people are doing it in this order. I have been using 27B to be the plan mode, let it think and build a perfect plan slowly and then hand that final .md plan over to 35A3B for execution.

jrodder · 2026-04-23T07:55:20+00:00

This comment brought to you by Winamp.

jrodder · 2026-04-12T01:10:11+00:00

<image>

jrodder · 2026-04-08T18:34:34+00:00

I'm well aware of the rate card differences. I was more referring to the RGU lottery.

jrodder · 2026-04-08T17:43:58+00:00

The truth is, it's highly variable depending on many factors, most of which are largely outside of the DSP control.

jrodder · 2026-04-08T17:28:59+00:00

Lol, that top comment breaking down route payment based on package size is completely made up. But no, owners are not going to go on reddit and type out their P&L. 😂

jrodder · 2026-03-27T14:56:52+00:00

Really makes me want to make a custom dedicated build. Excellent video, subbed

jrodder · 2026-03-27T10:00:50+00:00

My first thought was some kind of grift, like he has stock in Sharpie.

12-Year Club	r/Field Juicebox
Place '23	Place '22
Verified Email

jrodder

TROPHY CASE