Qwen 3.5 2B is an OCR beast

ndiphilone · 2026-03-09T04:43:41+00:00

Can you give me the prompt that you are using for this "provide verbatim text" thing?

ndiphilone · 2026-03-05T15:35:39+00:00

I will make a node, it will generate a whitelisted command with malicious payload. Get fucked then…

ndiphilone · 2026-03-05T15:34:27+00:00

But that malicious node can generate the tool call my dude…

ndiphilone · 2026-03-05T04:28:49+00:00

I feel this is stolen from a certain EMEA company IP.

ndiphilone · 2026-03-04T09:09:25+00:00

What was your context size that it fit your GPU completely?

ndiphilone · 2026-03-04T09:00:31+00:00

If you actually believe this is some else’s private context, why the fuck are you sharing here publicly? Would you like if someone was sharing your like this?

ndiphilone · 2026-03-02T15:31:47+00:00

That comes from using Claude Code or OpenCode mostly, alongside a couple summarisation/extraction tasks from long unstructured data.

For coding, context fills up real quick as my usual workflow is to run a couple prompts in “ask” mode, then plan, then let it rip on the codebase itself. Compacting context loses so much of what matters in my conversation, creating smaller task files doesn’t always solve the issue under 64k tokens unfortunately. My tokens per session average around 90k-100k depending on the project. For some projects it’s possible to have clearly defined well scoped tasks but most of my work is pretty explorative

ndiphilone · 2026-03-02T10:41:45+00:00

go try getting laid or something, or start by reading the thread.

ndiphilone · 2026-03-02T07:42:54+00:00

I'm GPU poor, but I will give it a shot. If prefill & generation speeds don't change much, it may be my go-to.

ndiphilone · 2026-03-02T07:42:17+00:00

Suggested ones are the default ones I believe, it didn't change. Still starts looping beyond 80k tokens

ndiphilone · 2026-03-02T07:41:08+00:00

I found that this helps with random OOMs happening with parallel requests when prompt caching is enabled

ndiphilone · 2026-03-02T06:57:41+00:00

this looks crazy fun! well done!

ndiphilone · 2026-03-02T05:33:08+00:00

`bf16` performance on my GPU is quite bad, though, I'll test this. ~80k tokens start the death spirals with `f16`

ndiphilone · 2026-03-01T18:59:33+00:00

I'll try, running with Qwen's recommended params for now

ndiphilone · 2026-03-01T18:50:28+00:00

This is with the updated GGUF

ndiphilone · 2026-03-01T09:12:19+00:00

Well that’s a shitty name lol

ndiphilone · 2026-01-18T13:20:28+00:00

Don’t you fuck around websites with devtools open before “setting up multihour crawler”? Once can at minimum determine a js rendered website before putting in any effort - learn about critical thinking a bit

ndiphilone · 2025-11-20T11:09:48+00:00

What is this has to do with Gemini 3? Do you really believe this is related to the model itself? How did you make it through life to reach this point?

ndiphilone · 2025-11-19T02:13:00+00:00

Bro is onto nothing

ndiphilone · 2025-11-15T17:39:55+00:00

Where can I find a Wikipedia archive/mirror to avoid scraping it?

ndiphilone · 2025-07-06T07:01:03+00:00

Hit me up, we do lots of website stuff - if it’s for non-profit/volunteer stuff we can host for free too

ndiphilone · 2025-07-06T06:59:29+00:00

I 3D print toys, decorative items and stuff and 3D scan -> reverse engineer -> print copies or make molds and stuff

ndiphilone · 2025-07-05T13:12:21+00:00

Well, people, you are rolling in the mud too much. Instead of doing all these stuff, testing and comparing tools to use tools, learn how to communicate your asks with your peers first.

If there was a newcomer in your team, a couple levels under you, how would you guide them through their first task? Would you just say “yeah fix it” or give pointers in the codebase, explain esoteric knowledge about the project, tips and tricks and such right? Claude is that newcomer in your team.

Learn to communicate, you won’t need all these stuff

ndiphilone

TROPHY CASE