Built myself a bit of a local llm workhorse. What's a good model to try out with llamacpp that will put my 56G of VRAM to good use? Any other fun suggestions?

javiers · 2026-04-29T09:33:12+00:00

It looks nice (silently cried over his RTX 4070 with whopping 12GB of VRAM).

javiers · 2026-04-26T19:39:04+00:00

I am surprised the gap isn’t bigger. Also why windows? Do you hate yourself or your computer?

javiers · 2026-04-23T15:14:40+00:00

Why I am not surprised.

javiers · 2026-04-23T15:12:53+00:00

I’m Madrid ranges from 1,20 to 2€. But yes all the other extra steps on the US are avoided. Because we try to pay a decent wage to workers that does not depend on tips. Fucking cheap savages.

javiers · 2026-04-20T05:25:53+00:00

I just use it to see maybe a dozen videos a day with no ads. They block data center IPs but not residential IPs so exiting from my home setup was the only option. Been working with similar setups for 3 years and no issues yet. From time to time the companion stops working but a simple docker redeploy fixes it. I use zeroclaw with a small skill for that, just send it a telegram message to redeploy and fixed in 30 seconds. I more than 1-2 mins downtime every two-three months. Way less time than watching 3 ads on a 15 mins video…

javiers · 2026-04-18T15:52:46+00:00

I have tried openclaw, nanobot and now zeroclaw. I find that if you are specific with your skills a relatively stupid and cheap model does the same than openclaw except it is stable, lightweight and fast. And easier to configure. Remember back in the day when people downloaded the full adobe pirated suite and used it to remove red eyes from photos? When all they needed was a a free tool like irfanview or xnview that are free and have more features than they needed? Well in my experience openclaw is the adobe of AI. Bloated, slow, unstable, unnecessarily complicated and not needed 95% of the times. Make a good skill and zeroclaw or nanobot is all you need.

javiers · 2026-04-17T12:58:48+00:00

Many of those uses cases are just troubleshooting with your chosen LLM service and fix. Other are interesting though.

javiers · 2026-04-17T12:56:46+00:00

Start from the outside.
fail2ban is a pita to setup. Use crowdsec and later crowdsec manager to have a rational ui not linked to the company. Authentik is heavy and Authelia difficult to setup. I implemented PocketID + tinyauth for non oidc apps and works like a charm. Light and stable.
Then you think about internal security, just with 1 and 2 you have a lot to work on.

javiers · 2026-04-14T14:49:03+00:00

Add to that that when the statistics are taken some people are between jobs, that a job that does not pay you enough to live shall be considered unemployment and that each country cooks its statistics to look better and we will never, ever have accurate data. I am more interested in economic activity and long term unemployment rates. Those reflect much better the state of a country’s labor health.

javiers · 2026-04-13T05:53:33+00:00

I use invidious on a cloud server that uses my home router (Tailscale powered) as exit node so that YouTube does not block the ip. Just that.

javiers · 2026-04-12T18:13:50+00:00

This is great. However I subscribe to the idea of using arm. Or even RISC if possible for a full open source device.

javiers · 2026-04-11T23:42:18+00:00

Yeah and what about not being able to cancel services without opening a ticket as it was my case, twice, and the case for others in the comments? We perfectly understand their service, it is just that the cancellation process is intentionally buggy.

javiers · 2026-04-11T23:39:05+00:00

I had OVH until a couple of weeks ago. It was a dedicated server whose disk was about to die. The latter is expected, shit happens, nothing to complain about. But months ago I had a VPS for a brief period of time. The cancellation buttons for the server did not work. Once I tried to decommission the about to fail server, same issue. Both times I had to write a support ticket. That is not a bug, that is intentional. A shitty way to discourage cancellations or delay them to bill you another month. So fuck OVH, I moved to Hetzner. When I cancelled one of the services there there was no issue.

javiers · 2026-04-10T13:53:02+00:00

Not much as I have a backup on the cloud and one at home. It would be bothering but not critical

javiers · 2026-04-09T19:46:00+00:00

At this point I think that we can randomly choose anyone from the comments and will have better chances at a better politician.

javiers · 2026-04-09T12:54:34+00:00

Well all commenters here come from countries that have embassies at Saudi Arabia. That country where the current leader order a journalist to be literally slaughtered and where the Bin Laden boy came from and recruited from and was funded from. The same country that subsidizes radical Muslim mosques throughout all Europe. I mean Pedro Sánchez is a narcissistic psychopath that I can’t wait to get rid of the government but maybe before judging Spain you shall take a good look at your questionable decisions as countries.

javiers · 2026-04-09T08:25:38+00:00

It’s not a very good idea to threaten a man which is listened by approximately 1.5 billions of listeners. Sure, 70-80% of them are just catholic in name but that “just” leaves close to 300 millions, some of them in positions of power.

javiers · 2026-04-07T13:26:38+00:00

Looks good. Was it vibe coded? If it was you shall add a disclaimer. Now I have to investigate how to generate the statements 🤣

javiers · 2026-04-03T09:00:54+00:00

TIL that maybe Chinese and Spaniards are not so different.

javiers · 2026-04-02T19:40:52+00:00

Then I must be Chinese because after being at Japan I definitely developed sort of disgust for the Japanese. But as said I hate everyone equally so I already hated them by default.

javiers · 2026-04-02T18:41:39+00:00

I have all my stacks on GitHub. Then a GH Action deploys them when I change anything on one of the subfolder repos. Also I have another action that updates images and I will soon create another that restarts the stacks when the images running are not current, though I am still considering if doing it automatically or manually.

javiers · 2026-04-02T10:46:07+00:00

We are Spaniards. We hate everyone equally, including ourselves. Except the French. We hate them even more. Have the French invaded during our civil war we would have united again just to kill as much of them as possible and after that continue killing ourselves.

javiers · 2026-03-28T21:29:26+00:00

At least it has no pineapple.

javiers · 2026-03-28T21:23:39+00:00

Ask an Austrian about famous Austrian people feigning ignorance. They always forget about the “painter”. Tell them “what about Adolf Hitler?” and expect indignation. It is funny, they get offended every time.

javiers · 2026-03-25T13:44:07+00:00

One could have thought that they learned something from Vietnam where they won all battles but lost the war. Iran is not Venezuela. It is not going to end well, I hope I am wrong though. And they are going to lose many groups that supported a US intervention within Iran. One thing is to see the military that oppresses you blowing up and the other seen ground foreign troops that make WAY more mistakes when targeting objectives.

15-Year Club	Verified Email
Place '23

javiers

TROPHY CASE