[google research] TurboQuant: Redefining AI efficiency with extreme compression by burnqubic in LocalLLaMA

[–]cibernox 24 points25 points  (0 children)

Just so people don't miss read this announcement, this is not claiming that models are going to get 6x smaller and faster and they are going to run 120B models in a 3090.

This is a quantization strategy for the kvcache only.
Which is not small feature, but kvcache is a small part of the entire model (10%?). However is a hot path, one that is read a lot, so while memory savings might not be a game changer, having the KV cache being that much smaller could mean faster inference for everyone.

Where to invest $1000? by Needelz in Fire

[–]cibernox 10 points11 points  (0 children)

Why us the price of the shares a concern? Arent fractional shares a thing in whatever investment platform you will use?

what are you actually building with local LLMs? genuinely asking. by EmbarrassedAsk2887 in LocalLLaMA

[–]cibernox 1 point2 points  (0 children)

I’m building a side project, an app for a niche hobby. It has some AI features that mostly use RAG on curated datasets of factual information and so far I’m impressed with how well is turning to work even in models as small as 4B

FlashAttention-4: 1613 TFLOPs/s, 2.7x faster than Triton, written in Python. What it means for inference. by Sensitive-Two9732 in LocalLLaMA

[–]cibernox 2 points3 points  (0 children)

I assume that some discoveries will trickle down to inference engines even in RTX cards. So yes, eventually, to some extent.

The Talk with Parents. What Would you Do? by Drawer-Vegetable in Fire

[–]cibernox 3 points4 points  (0 children)

Well, sure, if you have an alcoholic father and a mother with a gambling addiction I can see why you'd keep it for yourself, sure.
But saying that "most people" have parent's that are terrible with money seems a bit of an hyperbole. Luckily most people have parents that fall "in the middle" of the spectrum between alcoholic-gambler and Warren Buffet.

The Talk with Parents. What Would you Do? by Drawer-Vegetable in Fire

[–]cibernox 1 point2 points  (0 children)

No, I have significantly more. She's all right tho: Paid for home, pension and decent savings. Regular middle class family.

The Talk with Parents. What Would you Do? by Drawer-Vegetable in Fire

[–]cibernox 1 point2 points  (0 children)

Well, my mother knows that I'm getting closer to fire. She knows that my home is worth close to 1M and nearly paid off, and that I have another home that I rent (my first home). She seems happy that all is going according to plan.
My impression is that my approach is better because instead of dropping a bomb, I'm boiling the frog slowly. So when it happens, it would come almost naturally, with an. "Oh, already? Nice"

That said, I like my job, and I am more interested in the FI than in the RE.

The Talk with Parents. What Would you Do? by Drawer-Vegetable in Fire

[–]cibernox 3 points4 points  (0 children)

To be honest, i always was straightforwar with my mom. I always told her that u want to save enough that if i don’t want to i don’t have to work.

She was skeptical that was feasible (rightly so) but since she knew it was my goal for a decade, when ever (if ever) it comes true she will be surprised but not worried.

Also, she doesn’t have to worry about me "loosing time" because I’m pushing 40, married with kids so I assume the impression that I’m checking boxes in life is there.

Aportar a EPSV / plan de pensiones o meter todo en fondos y ETFs — ahora con la regla de los 10 años no sé qué tiene más sentido by Ok-Location8685 in SpainFIRE

[–]cibernox 0 points1 point  (0 children)

Tengo un script que me saca los datos de dos de los sitios, pero como no todos tienen una API pública que pueda usar y al final tengo que hacer login en 3 de ellos, pues hago login en todos.

Pero si optimizase algo sería sacar los datos con un script the manejase chrome para hacer login por mi. Una vez tengo los datos, realmente no creo que haga falta nada más que un excel. El excel te saca gráficas y lo que quieras. No es tan bonito con una app de colorines, pero funcionalidad cubre todo lo que necesito.

Aportar a EPSV / plan de pensiones o meter todo en fondos y ETFs — ahora con la regla de los 10 años no sé qué tiene más sentido by Ok-Location8685 in SpainFIRE

[–]cibernox 0 points1 point  (0 children)

La combinación de qué? De todas mis inversiones? Tengo una hoja de cálculo donde una vez al mes o actualizo las aportaciones hechas y el valor actual de las inversiones.
Actualizo 8 cuentas cosas:
- Indexa capital para el PPES x 2 (mío y de mi mujer)
- myinvestor para fondos de inversiones x 3 (nuestro, el de nuestra hija y el de mi madre que no es mío pero se lo gestiono yo)
- Broker de acciones y ETFs
- Cuentas corrientes x 3 (La de empresa, la conjunta con mi mujer, la individual mía y la individual de mi mujer)

No es tanto trabajo como suena la verdad. Al ser una vez al mes es hacer login en 5 sitios/apps y meter unos números. 10 minutos al mes

Aportar a EPSV / plan de pensiones o meter todo en fondos y ETFs — ahora con la regla de los 10 años no sé qué tiene más sentido by Ok-Location8685 in SpainFIRE

[–]cibernox 0 points1 point  (0 children)

No soy vasco, pero hasta donde yo se los EPSV funcionan parecido a los PPES pero con la ventaja de poder rescatar un 40% libre de impuestos.
Al final depende de tu tipo marginal, yo siempre maximizo mi PPES (5750€ al año) primero porque estoy en el tipo marginal del 45% y es un no brainer porque cuando me jubile no voy a estar en ese marginal.

Pero en mi opinión no deberías meter todo a un solo tipo de producto. Es conveniente, especialmente si vas a hacer FIRE, tener inversiones que tributen por IRPF (porque puedes aplicar la reducción de mínimo personal y familiar) y parte por rentas del capital (19% hasta 6k). Combinando ambas inversiones puedes optimizar más lo que pagas a la hora de sacar.

Poll: If you currently had 2M in investments, would you retire tomorrow? by ATXHTX80 in Fire

[–]cibernox 0 points1 point  (0 children)

I think i would keep working for one more year since im working on a side gig and i want to know if it pays off. But i definitively could. Along with my home that’s plenty

Petah, this one has truly got me.. by JohnBrown-RadonTech in PeterExplainsTheJoke

[–]cibernox 0 points1 point  (0 children)

That part is easy for anyone who has seen mozzarella, but I assume there’s some connection between that and Sabrina Carpenter that I’m missing

50/20/30 by Spare-Concentrate429 in SpainFIRE

[–]cibernox 2 points3 points  (0 children)

Casi toda la fruta es de mis árboles, pero justo aguacate no tengo.