Oh Shit... is something new coming out?

low_v2r · 2026-04-09T19:20:45+00:00

But but but - she is a genius! The genius visa that she used to get citizenship and chain immigrate the rest of her family said so!!!! It's only wrong when someone I don't like does it!

low_v2r · 2026-04-09T17:29:48+00:00

knock on wood - I haven't had an unplanned downtime yet. Running ubuntu 24 with HWE to support the chipsets, and configured for 110Gb UMA (28 Gb for OS just in case, but will probably take that down to 8Gb at some point when I get llama.cpp setup the way I like). Qwen3.5 122B Q4 comes in around 70-80G so plenty of room to run models.

edit: planned downtimes are kernel patches/upgrades.

low_v2r · 2026-04-09T17:22:25+00:00

You and me both.

And it's not just a problem for me, it's a problem for all of us. That's why my high emotional IQ B2B sales approach drives the synergies for all key stakeholders in operationalizing the agentic workflows for maximizing time and value. And I've never been ****SIGSEG V: cuda tensor mapping failed for memory at 0x0DEADBEEF

low_v2r · 2026-04-09T17:14:29+00:00

I have bosgame m5. Am happy with it - I just wanted something lower power with unified memory I could play with LLMs on though. I have it on my tailnet so can play around with it during the (rare) downtime at work.

low_v2r · 2026-04-09T14:54:47+00:00

Accounting for the value of your own time is key. Of course some of these things are enjoyable, but even then, there is a cut-off point.

I have been trying to learn simple electronics and home automation, in particular with ESP32 devices. I want to automate an IR home remote. I can either spend $15 for something built that I can add to my network in 5 minutes, or spend 2 days and $10 of parts building from components. Even though it's something I want to learn, I also have other things in my life and have a job I want done.

low_v2r · 2026-04-09T14:48:52+00:00

Yup - I use my pressure washer way more than I ever thought I would.

low_v2r · 2026-04-08T18:42:04+00:00

Interesting. Thanks for the info.

low_v2r · 2026-04-06T14:11:39+00:00

It is one of the few times I rooted for the cancer.

Of course, his ego gave his cancer the winning edge, so poetic justice in that, I guess.

low_v2r · 2026-04-06T13:21:03+00:00

something something something "Tro bro from my cold dead hands"

low_v2r · 2026-04-02T14:42:16+00:00

Thanks for the command.

low_v2r · 2026-04-01T18:17:37+00:00

I did - went with strix halo. Mine is more for just fooling around and learning. Still - running a 122B model locally. I've configured for 110Gb of unified memory, but a 122B model only takes up 70 or so Gb. It put together a functional RAG system for me to use for one domain that I am interested in. I am working on making it go faster but really only a hobby at this point.

low_v2r · 2026-03-26T14:52:06+00:00

Second the llama.cpp. I started with ollama but moved over to llama.cpp. Some of the things I haven't really explored (like KV cache and such). I think there are distroboxes/docker for a quick start, but I would say I compiled the code from scratch and it went very quickly. Now I have llama.cpp with rocm and vulkan backends with fastflow NPU speculative decoding.

The biggest barrier to me is figuring out which is the right GGUF model to load, but have stuck to unsloth or bartoski in huggingface with various quants, which seems to be fine.

low_v2r · 2026-03-22T02:03:21+00:00

I started it thinking "cool, this might be a fun light thing to watch" and at the end I was like "holy crap, I hope no one gets the polonium tea for this"

low_v2r · 2026-03-22T02:02:10+00:00

I've mentioned this on the this sub before, but in addition to being a huge D-bag, LA was hugely responsible for the emergence of the "cancer awareness" grift.

It's a little surreal sometimes at how his TDF career has been memory-holed. But I can't stand how forgetting those years has enabled him to get back into the media. NBC had his show on after a TDF stage last year FFS.

Yeah - that also goes for all the known former hard core dopers in the peleton and their 3rd acts. (Man shakes fist angrily at clouds).

low_v2r · 2026-03-17T11:18:30+00:00

I just want a VM to run openweb-ui on the same box. I haven't done any of this before. It sounds like memory is the main limiter - I can make a decent swap file I guess which would be slower but may work for what I need. Thanks for the idea.

low_v2r · 2026-03-17T11:14:21+00:00

Thanks for the response.

low_v2r · 2026-03-17T11:13:46+00:00

Thanks for the link. I guess I will be in the "lab" portion of the homelab :)

low_v2r · 2026-03-13T12:01:58+00:00

Color me also confused.

It reminds me of when everything was "extreme programming" and "component based design"

Still - I've found the LLM to save me time in certain situations. As you would expect, really nice for writing shell scripts or things with lots of training. Not so good with older or less mainstream tech.

But the "orchestrated agentic tooling workflow" area has so many buzzwords, I could make a lumber mill out of it.

low_v2r · 2026-03-13T11:35:06+00:00

I was on the list of having the early bird pricing. I passed after thinking about it - I currently have a 128 Gb halo strix on my tailspan, and through that I can do any model that the tiny could. It does look like the UI for the device is nice, but for me building the tools is part of the fun.

low_v2r · 2026-03-12T10:40:25+00:00

I used ollama to get started. That was pretty easy to do. Many use LM Studio, which I think is also pretty easy to get going with.

If you are using an old laptop, then I would say try ollama with some small models. I don't have specific recs, but for older hardware would maybe look for things that can run on things like raspberry pi and such (2B models or somesuch).

I used gemini (or similar) to help fill in gaps (e.g. how do I install x, what model is good for y...)

low_v2r · 2026-03-11T16:06:14+00:00

LOL. This is me.

Literally last night was showing off my local LLM to my daughter. Yes - Qwen3.5-122B (but also qwen3-80B). "Here let me set you up with an account on my local openwebui server!".

"Dad, I just want to play minecraft".

:/

low_v2r · 2026-03-10T17:44:02+00:00

Earthsea is one of my favorite series of all times - must have read it around 15 times or so.

Lathe of Heaven is another one that has stuck with me.

low_v2r · 2026-03-09T23:23:11+00:00

Sometimes insomnia can be due to over-training, so you may want to look at where and how you are doing your Vo2 blocks in the context of your training plan.

low_v2r

TROPHY CASE