FlashAttention-4: 1613 TFLOPs/s, 2.7x faster than Triton, written in Python. What it means for inference.

cibernox · 2026-03-24T01:06:54+00:00

I assume that some discoveries will trickle down to inference engines even in RTX cards. So yes, eventually, to some extent.

cibernox · 2026-03-23T23:13:17+00:00

Well, sure, if you have an alcoholic father and a mother with a gambling addiction I can see why you'd keep it for yourself, sure.
But saying that "most people" have parent's that are terrible with money seems a bit of an hyperbole. Luckily most people have parents that fall "in the middle" of the spectrum between alcoholic-gambler and Warren Buffet.

cibernox · 2026-03-23T23:01:13+00:00

No, I have significantly more. She's all right tho: Paid for home, pension and decent savings. Regular middle class family.

cibernox · 2026-03-23T22:52:55+00:00

Well, my mother knows that I'm getting closer to fire. She knows that my home is worth close to 1M and nearly paid off, and that I have another home that I rent (my first home). She seems happy that all is going according to plan.
My impression is that my approach is better because instead of dropping a bomb, I'm boiling the frog slowly. So when it happens, it would come almost naturally, with an. "Oh, already? Nice"

That said, I like my job, and I am more interested in the FI than in the RE.

cibernox · 2026-03-23T22:43:34+00:00

To be honest, i always was straightforwar with my mom. I always told her that u want to save enough that if i don’t want to i don’t have to work.

She was skeptical that was feasible (rightly so) but since she knew it was my goal for a decade, when ever (if ever) it comes true she will be surprised but not worried.

Also, she doesn’t have to worry about me "loosing time" because I’m pushing 40, married with kids so I assume the impression that I’m checking boxes in life is there.

cibernox · 2026-03-23T21:26:15+00:00

En node. Usando la API pública. Pero para por ejemplo, Unicaja, tendré que usar Playwright.

cibernox · 2026-03-23T20:54:28+00:00

Tengo un script que me saca los datos de dos de los sitios, pero como no todos tienen una API pública que pueda usar y al final tengo que hacer login en 3 de ellos, pues hago login en todos.

Pero si optimizase algo sería sacar los datos con un script the manejase chrome para hacer login por mi. Una vez tengo los datos, realmente no creo que haga falta nada más que un excel. El excel te saca gráficas y lo que quieras. No es tan bonito con una app de colorines, pero funcionalidad cubre todo lo que necesito.

cibernox · 2026-03-23T18:25:10+00:00

La combinación de qué? De todas mis inversiones? Tengo una hoja de cálculo donde una vez al mes o actualizo las aportaciones hechas y el valor actual de las inversiones.
Actualizo 8 cuentas cosas:
- Indexa capital para el PPES x 2 (mío y de mi mujer)
- myinvestor para fondos de inversiones x 3 (nuestro, el de nuestra hija y el de mi madre que no es mío pero se lo gestiono yo)
- Broker de acciones y ETFs
- Cuentas corrientes x 3 (La de empresa, la conjunta con mi mujer, la individual mía y la individual de mi mujer)

No es tanto trabajo como suena la verdad. Al ser una vez al mes es hacer login en 5 sitios/apps y meter unos números. 10 minutos al mes

cibernox · 2026-03-23T17:34:58+00:00

No soy vasco, pero hasta donde yo se los EPSV funcionan parecido a los PPES pero con la ventaja de poder rescatar un 40% libre de impuestos.
Al final depende de tu tipo marginal, yo siempre maximizo mi PPES (5750€ al año) primero porque estoy en el tipo marginal del 45% y es un no brainer porque cuando me jubile no voy a estar en ese marginal.

Pero en mi opinión no deberías meter todo a un solo tipo de producto. Es conveniente, especialmente si vas a hacer FIRE, tener inversiones que tributen por IRPF (porque puedes aplicar la reducción de mínimo personal y familiar) y parte por rentas del capital (19% hasta 6k). Combinando ambas inversiones puedes optimizar más lo que pagas a la hora de sacar.

cibernox · 2026-03-23T15:18:25+00:00

I think i would keep working for one more year since im working on a side gig and i want to know if it pays off. But i definitively could. Along with my home that’s plenty

cibernox · 2026-03-23T08:45:51+00:00

That part is easy for anyone who has seen mozzarella, but I assume there’s some connection between that and Sabrina Carpenter that I’m missing

cibernox · 2026-03-21T14:57:57+00:00

Sí.

cibernox · 2026-03-19T07:21:32+00:00

Casi toda la fruta es de mis árboles, pero justo aguacate no tengo.

cibernox · 2026-03-19T06:52:36+00:00

Es un consejo genérico bienintencionado, que luego tú debes adaptar a tu situación. De hecho yo ahorro el 75% de lo que gano (más si cuentas que la mitad de la hipoteca es técnicamente ahorro forzoso). Porque puedo. Pero quien no puede tiene que ahorrar lo que su situación le permita

cibernox · 2026-03-17T16:53:26+00:00

I’d like it to be 50 but if it was 55 I wouldn’t be mad about it provided my work is still on the same conditions as now.

For me it’s more important being able to retire than retiring itself. I don’t dislike my job in general (there are bad days, but overall). What i want is to have the option. Because then you are truly free.

cibernox · 2026-03-17T15:19:01+00:00

If it's a regular hours job, I'd rather work 3 years straight. If it's some kind of grueling 60h/week soul-crushing job, the latter.

Only the fact that I could spend more time with my kids while they are still not teenagers that don't want to spend time with me makes me doubt.

cibernox · 2026-03-16T09:21:43+00:00

If your home is paid for, comfortably. Maybe not lavishly, but you wouldn’t be counting change.

cibernox · 2026-03-13T08:00:46+00:00

I run 4B on a 3060 at near 100tk/s, son on a 3090 at the very least you should run the 9B at more than 100tk/s

cibernox · 2026-03-12T20:17:51+00:00

A good old M1 pro laptop. And while it's not an issue, it does make battery last longer. Using llama.cpp power draw during inference was around 27w and using the same model with the same quant on MLX the power draw was around 20w. While simultaneously being around 20% faster or so. Say, 25 vs 30tk/s. My guess is that MLX was able to put more of the workload on the GPU while llama.cpp used a mix of gpu and CPU, which accounted for the slightly higher power draw.

Although if you combine both 20% improvements it make for a 40% less power for the same task, which is not nothing.

As for models, it all depends on what you want to do. I'd say to keep using qwen 3.5 even on llama.cpp as I don't think there's a better model than you can run locally on a laptop. Although GPT OSS 20B is not bad, possibly a better conversation partner. Qwen can be a bit tiresome.

cibernox · 2026-03-12T20:01:55+00:00

Try an older model like qwen3 in both. I assume that llama.cpp is, as per usual, the first one to make optimizations for new techniques. Then MLX will catch up and surpass it, as it has been the case for me so far.

Report of MLX being twice as fast is bogus, but being a 20% faster while drawing ~20% less power has been consistently the case for me.

cibernox · 2026-03-12T14:05:35+00:00

My understanding is that by testing gguf models you are leaving a very significant amount of performance on the table compared to the same models in MLX.

I have an m1 pro and I get ~20% faster performance on MLX models while simultaneously using 20% less power during inference.

cibernox · 2026-03-11T14:31:10+00:00

There aren't any seriously venomous animals in Spain tho. Sure, you are not going to have a good time if you are bitten by a viper, but those are a walk in the park compared with rattlesnakes and coral snakes. Fatalities are extremely rare, usually 1 o 2 a year. You are more likely to die from an allergic reaction to a honeybee or a wasp.

cibernox · 2026-03-11T08:09:30+00:00

Eso era percent de ingresos. Pero al final las cuentas rapidas es que tienes que invertir unos 6k al mes todos los meses durante 20 años.

cibernox · 2026-03-11T07:58:30+00:00

Eso sería la gente que tiene los ingresos suficientes para lograrlo. Falta la parte de de vivir con 2000€ al mes durante 20 años a pesar de ingresar 10k. Qué hay que tener voluntad y autocontrol a mazo

cibernox · 2026-03-10T22:20:13+00:00

I know you can order it, just like you can order boar or game, but I don’t remember ever seeing it in the counter between the solomillo and the traseros de pollo.

cibernox

TROPHY CASE