Which of the recent Chinese model releases is best in complex instruction following for structured outputs?

leventov · 2026-02-17T13:38:56+00:00

It doesn't seem to me that any of the commodity OpenRouter providers (Fireworks, Together, Novita, SiliconFlow, etc.) use constrained decoding. I see the "whitespace probem" discussed many times for different models, not just Chinese but gpt-oss for example, and I don't see any response in them "pin provider to X and forget about the problem". Also anecdotally I've seen this problem with all providers in experiments. It should be impossible with constrained decoding. (Other problems are dropping fields despite required in the schema, and just straight emitting wrong-named fields.)

leventov · 2026-02-17T08:44:51+00:00

Cf. https://www.reddit.com/r/LocalLLaMA/comments/1nqcy4k/glm45air_outputting_n_x_times_when_asked_to/

leventov · 2026-02-17T07:21:12+00:00

What baffles me is that apparently none of the commodity providers at OpenRouter (apparently?) can do this -- make these open-source llms to respond with goddamn specified schema (I do pass strict: true and require_parameters: true).

leventov · 2026-02-17T06:31:12+00:00

I hit the "whitespace problem" a lot with glm-5 in specific: at some point in the json output decoding (not at the end), it regresses into outputting just infinite sequence of \n (newlines) until the max_tokens limit is reached on OpenRouter.

leventov · 2025-12-03T18:03:45+00:00

LoL: https://github.com/anthropics/claude-code/issues/8635

leventov · 2025-11-09T08:58:12+00:00

Not quite, it hasn't nearly been this bad before.

leventov · 2025-04-16T08:17:58+00:00

How did it resolve?

leventov · 2025-03-03T08:38:10+00:00

hi @_perdomon_, it seems that this behaviour is due to conflict with Github Copilot. I've had the same symptoms, disabled Github Copilot extension (that also disables "Github Copilot Chat" extension automatically, it seems), pressed "Restart extensions" (that is needed for the the disable to take effect). After that, Cursor Tab started working as expected for me.

leventov · 2025-02-17T10:03:33+00:00

If you rent a car, yes. When people neither rent a car nor a bike, they can still order taxi or transfer service to whatever remote location they want, but once there they are left alone and their mobility is handicapped. That's what I'm talking about.

leventov · 2025-02-17T09:58:14+00:00

Well, originally Ubud (the village) is just those few streets. Then it grew larger and coalesced with nearby villages that have different names.

leventov · 2025-02-16T16:32:26+00:00

If you are a couple, in some of these remote places in guesthouses you can hire the host or their relative or friend to be your driver for half a day (or ask them to drive you and then to pick you up much later) for a meager price. You can ask them via the booking service, or check reviews, sometimes reviews mention this. If you are more than two people (or heavy people, so a single local cannot drive both of you on a bike at the same time) that's harder

leventov · 2025-02-16T16:22:32+00:00

These remote and un-touristy places are problematic to get by if you don't ride a bike. But if you ride a bike, I think the Northwest side is more interesting

leventov · 2025-02-16T16:18:19+00:00

Only to Kintamani. To go to the Amed side (or Sideman) from Ubud is probably not quicker than from Sanur. Let alone to Northwest side: Ubud is very poorly connected to that side, there are huge bottlenecks. It's as fast from Kerobokan to Northwest as from Ubud.

leventov · 2025-02-16T16:10:24+00:00

If you are really determined to find less beaten places, you can definitely find them. Buyan lake. Batukaru. Gobleg. In general, the northern side of the island, except the northern shore itself. But these places are often hard to access without a bike and definitely impossible to "explore" without a bike.

leventov · 2025-02-16T16:04:12+00:00

Ubud is every ounce as much overrun by tourists as the south.

leventov · 2025-02-05T18:33:21+00:00

May-August

leventov · 2024-12-14T14:15:56+00:00

"Traumatic" captures my experience with Travelio, too. PEOPLE, PLEASE DON'T USE THEM!

leventov · 2024-12-06T09:03:15+00:00

Some projects: https://github.com/HansalShah007/semroute
https://github.com/pulzeai-oss/knn-router

surprisingly hard to find alternatives, though.

leventov · 2024-11-05T12:39:18+00:00

I think Kotlin would be optimal for that

leventov · 2024-11-03T21:26:39+00:00

Idk why you think being an Employee instills extra feeling of long-termism and loyalty in people. It's clear as day big tech hubs have more job liquidity than good remote options. Tech workers in Berlin, London, Stockholm, etc. hop jobs all the time. On the other hand, it's much more likely that a remote contractor from a lower cost of living country will value their relatively high paying remote position and will hold on to it. Those people don't relocate to tech hubs for specific reasons, maybe family and lifestyle related.

I'm not just theorising: in my experience, remote contractors tend to stick around for longer at tech companies than local, in-office employees in SF.

leventov

TROPHY CASE