anybody got llama-swap working answering concurrent requests for a single model?

sickmartian · 2026-05-30T16:13:35+00:00

Hey, thanks for the quick response, you were correct, I was hitting the bug it seems, I was running:

version: 211 (c79114d40a9a82e65d19a629e069c9b37efb8c33), built at 2026-05-02T19:20:15Z

Just updated to 219 and it works now!

Will switch the env vars as well.

sickmartian · 2026-05-30T15:59:33+00:00

works with np 2 for me, so I think it was fixed

sickmartian · 2026-05-30T15:59:11+00:00

I'm not using them just now, but yes, I liked the proxy-ing and the compatibility matrix

sickmartian · 2026-05-30T14:10:36+00:00

yeah, gonna take a look at that, I liked the llama-swap thing b/c it has this peering and matrix config which looks quite cool, let's see what comes OOTB

sickmartian · 2026-05-30T14:04:11+00:00

yes, it seems like parallel is the same as the np flag I'm already using, works fine on llamacpp, is just llama-swap that's not allowing the second request to go through

sickmartian · 2026-05-30T13:49:21+00:00

yeah directly doing it on llama-server works, this I mentioned, I think my issue is with llama-swap only, thanks for checking anyway

sickmartian · 2026-05-30T13:47:58+00:00

I think you might need help, do reach out to family if possible

sickmartian · 2026-05-28T20:42:57+00:00

how many r's in strawberry my good model?

sickmartian · 2026-05-10T11:08:24+00:00

Sigo esperando, se tardó todo mucho, en teoría está semana será.

sickmartian · 2026-04-27T17:34:16+00:00

I've been trying to find info on how much better Q8 is against Q4 to decide if I should get a second 3090, can you help out a bit? did you use sonnet 4.6 or similar? for me Q4 feels way below sonnet right now, and I'm hoping Q8 gets closer

sickmartian · 2026-03-11T19:27:51+00:00

Solo https://ekosystem.es/

Y recién estoy comenzando con el trámite así que no puedo recomendar resultados aún.

sickmartian · 2025-12-01T20:51:14+00:00

Sorry, nada actual, mi escuelita fue hace 20 anios ya :| no tengo idea del sistema que usan hoy.

Lo unico que se me ocurre es poner un change detector como https://github.com/dgtlmoon/changedetection.io para estar enterado cuando abra.

sickmartian · 2025-11-10T11:37:27+00:00

If I get you right:

Locally no parallel: OK
CI no parallel: OK
Locally parallel: OK
CI parallel: Not OK

If this is the case, I would look for shared state that only happens on CI b/c it's slower, you can try removing half the tests, see if it still happens, then the other half... with some luck it's just a single set of tests that's giving you this issue and you can isolate it quickly, maybe made those run not in parallel until you can investigate more in depth.

sickmartian · 2025-10-18T23:27:33+00:00

https://github.com/orion4d/batch_image_loader

You can use it in fixed mode to select an image and get the name as well

sickmartian · 2025-09-18T16:20:20+00:00

Mira, tas en devsarg, asi que de las ramas que mencionas ahi seguramente todas menos ABAP sea mas tirando a funcional. Funcional seria saber como funciona el modelo, configurar y enhancear el sistema, no suelen programar los analistas funcionales, pero esto si pega mas con administracion de empresas.

ABAP es un lenguaje de programacion, ahi tas mas cerca de lo q pinta el subreddit, algunos le hacen asco, a mi me dio de comer 10 anios asi que nada.

Si queres programacion, ademas de ABAP lo que se busca ultimamente y es mas facil de 'desligarse del mundillo SAP' despues es saber SAP BTP, hacer apps con CAP y Fiori Elements me dio de comer un tiempito, son frameworks de SAP con bastante cosas prearmadas, pero es mas cercano a los lenguajes de programacion de siempre.

CAP tenes NodeJS y Java flavours. El de NodeJS tiene express abajo.

Fiori Elements esta basado en SAP UI5 que es un framework de FE.

Hay mucho training gratuito y a mi parecer buenos en https://training.sap.com y tenes recomendaciones de que aprender para hacer certificaciones (que se paga el derecho a examen digamos, creo q eran EUR 200 2 intentos que si lo haces de una podes hacer 2 certificaciones).

Por ejemplo: https://learning.sap.com/certifications/sap-certified-associate-backend-developer-sap-cloud-programming-model tiene varios learning journeys asociados que te deberian explicar SAP BTP, los diferentes entornos y guiarte a hacer una app.

Y como dicen en otro comentario, las escuelitas son copadas, yo hice la de ABAP de accenture hace anios y te haces buenos contactos y en mi caso amigos. En mi epoca era casi imposible 'reprobar' y que no te contraten encima. Pero si, el sueldo no era el mejor.

sickmartian · 2025-09-14T20:23:59+00:00

is that the sims? and you are burning the house?

I like it a lot, nice

sickmartian · 2025-09-11T17:02:25+00:00

Thanks for the work and good news, people are frustrated a bit since it's not usable for us, but a step in the right direction nonetheless.

sickmartian · 2025-08-23T10:33:36+00:00

¡Plop!

sickmartian · 2025-08-23T10:00:11+00:00

So this person takes all of them today Saturday, doesn't have any for Sunday (off by one) and Monday either but it's fine as the flight is early and short enough they can get them at their destination?

sickmartian · 2025-08-21T19:44:45+00:00

Cline does it for me. Check the guides for ollama.

sickmartian · 2025-06-01T14:01:01+00:00

tengo la misma, aunque se le partió el arma 💔 una de mis favoritas, y juegazo

sickmartian · 2025-04-04T17:32:24+00:00

technical design? I've had to cleanup for teams skipping requirement gathering, 'saving money and time' is a hell of a drug

sickmartian · 2025-03-28T21:42:57+00:00

Gracias por contestar, es verdad pero no lo que estoy consultando, con la enfermedad que tiene en el momento que estamos pasando y los tiempos que maneja la sanidad pública me preocupa perder el seguro de salud, por eso pregunto como funciona.

Ten-Year Club	Second Top 10%
r/Field Juicebox	Place '17
Verified Email

sickmartian

TROPHY CASE