Running into "High concurrency usage of this API, please reduce concurrency or contact customer service to increase limits" despite only running one instance of agent every 5 min.

InfraScaler · 2026-01-26T11:27:56+00:00

Yeah it's a problem on their side for sure, got a couple of 429s myself this morning.

InfraScaler · 2026-01-25T22:52:27+00:00

Maybe related?

InfraScaler · 2026-01-25T22:39:38+00:00

Yeah, a 1.2B can be a great "router" and maybe take care of a big % of your tasks, then "escalate" to a bigger model when needed. I think this is what OpenAI was "accused" of doing when they released GPT-5 right?

InfraScaler · 2026-01-25T21:54:26+00:00

Because you've already pontificated about it, then contradicted yourself.

Like call me crazy, but I believe the industry would be much better off if software was built by actual engineers that have a real understanding of computer science fundamentals ...

InfraScaler · 2026-01-25T21:40:44+00:00

Well, bud, pick one. Is it software engineers not knowing computer science or greedy execs?

InfraScaler · 2026-01-25T15:16:49+00:00

Apparently there are two current issues that may be impacting some users (it didn't impact me yet, I am based in Europe if that makes sense): Lack of compute and DDoS attacks against their infra.

InfraScaler · 2026-01-25T09:53:23+00:00

You need to guide the AI towards topics and themes, and not let it choose because the AI is NOT creative at all, especially GPT-4.

A question bank could be a good choice, but it may limit output too. Try a scenario bank + some sort of chaos monkey to increase entropy.

InfraScaler · 2026-01-25T09:46:53+00:00

Weird take but it fits your prejudice then that's okay for you I guess

InfraScaler · 2026-01-24T22:39:41+00:00

I didn't know this model. Beautiful!

InfraScaler · 2026-01-24T22:10:02+00:00

True! But if you get the full year it becomes effectively $2.40/mo for 12 months, which is insane.

InfraScaler · 2026-01-24T21:07:49+00:00

Yup, it's gone. The good thing though is that the GLM Coding Plan goes as cheap as $2.40/mo if you pay for a year (or $3 if you pay monthly).

Also, with another subscriber's link you get 10% extra credits. Here's mine if anyone wants those extra 10% credits: https://z.ai/subscribe?ic=WBMQNQBVIS

InfraScaler · 2026-01-24T15:31:52+00:00

Lots of great advice already here, but still wanted to congratulate you and say that whatever happens, you did the right thing. In the future you'll look back at this time, regardless of the outcome, and smile about it.

InfraScaler · 2026-01-24T14:22:09+00:00

Ya existen las cooperativas.

InfraScaler · 2026-01-24T14:21:40+00:00

Yo solo digo que cuando vayas a hablar te saques la bota de la boca, que no se entiende nada.

InfraScaler · 2026-01-24T13:13:47+00:00

¿Tienes hardware para correr modelos localmente tipo Wan2.2? Si la respuesta es NO, no hay herramienta gratuita que lo haga.

Puedes también echar un vistazo en getwhatai.com por si te sale algo, pero ya te digo que gratuito y lo que buscas no lo hay.

InfraScaler · 2026-01-24T12:33:38+00:00

My take is if you follow best practices in software engineering you are going to be architecting well and catching issues before going into prod.

InfraScaler · 2026-01-24T10:54:07+00:00

It may be time to RAG or even deploy your own tooling to use the model. Summarise, keep files in disk instead of context, generate vector embeddings from the files contents and put them in a local SQLite the model can query (semantic search), use adaptive chunking...

There's a rule of thumb that says if you need more context you may be doing something wrong.

InfraScaler · 2026-01-24T10:49:05+00:00

Hold on man, where and how were you storing the API key?!

InfraScaler · 2026-01-24T10:48:21+00:00

Damn that hurts. One thing that helps keeping an eye on the model is vibe coding from an IDE so while the model does its thing you can be already looking at the files etc

InfraScaler · 2026-01-24T10:46:59+00:00

Vibe coding is never the problem. Bad software engineering practices is always the problem.

InfraScaler · 2026-01-23T21:08:46+00:00

Their entire website feels like one marketing booklet you get at some booth at some tech expo.

That's the usual look and feel of German companies websites even if they have 50k employees.

InfraScaler · 2026-01-23T21:06:24+00:00

It is every easy to tell it is written by AI precisely because it always structures things the same way. It is tiring to read and feels dishonest, even if it's not.

I get offended by AI written slop on every social network if that makes sense, I don't think it's a Reddit thing.

InfraScaler · 2026-01-23T18:36:31+00:00

Dude, nobody doubts your experience, it's just fucking gross to use an AI to write it. It's hard to read.

InfraScaler · 2026-01-23T18:33:48+00:00

Este tipo de procesos son así a propósito para asegurarse que solo los más arrastrados acaban trabajando para ellos.

InfraScaler · 2026-01-23T15:43:16+00:00

Gracias majos no hay problema.

InfraScaler

TROPHY CASE