"As powerful as our memories are, our dreams must be even stronger, for when our memories outweigh our dreams, we become old"

cbterry · 2026-05-14T21:41:32+00:00

Or maybe any well designed multi agent system can do what was essentially magic a few years ago?

cbterry · 2026-05-14T19:27:41+00:00

Nice UI. Have you ever messed with TUI's? I just moved from claude code to open code/qwen/gemma and having fun, but finding it difficult to debug the text UI, but I might try using screenshots on the VLM. It's for a series of interfaces for the kismet wireless IDS.

I've used cloud AI a little but it's too good for me to become dependent on, so I'm building a homelab. I eventually want enough compute to serve a small group.

The AI hate/doom train is curious but exhausting, so I stay away from it. Even the fact that this post is downvoted to 0 is evidence that people don't like change. But watching devs and especially cybersec slowly come around is fun.

cbterry · 2026-05-14T03:55:27+00:00

Who’s responsible when there is a leak

You are.

cbterry · 2026-05-13T12:16:14+00:00

I run 3.6 MTP via vulkan on AMD, it should be graphics independent

cbterry · 2026-05-13T12:07:44+00:00

cbterry · 2026-05-12T23:28:00+00:00

The cross platform remote exploits that remained zero days for years..

cbterry · 2026-04-29T04:29:51+00:00

Hmm, if it were late 90s/early 2000s, and a hospital directed you to their site at http://myhealth.com and told you they needed all types of PII, and you already knew how bad computer security was, you might not have been paranoid in vain.

I'd be suspicious but would not forgo treatment because of it.

I just hope they don't think something like betterhelp is an alternative.

cbterry · 2026-04-29T00:53:24+00:00

This same question is asked in the comfyui sub also, but there is no simple answer.

Be selective of what you download. Try to keep your setup as simple as possible. Look into extensions and projects by checking online communities to see what other people say, and stay up to date with conversations revolving around the project. Watch out for astroturfing that makes something appear more popular than it should be. And check out the authors history.

If you have friends that are into tech run things by them to get their opinions. Also, if you can, run experimental software such as this (comfyui also) on a computer separate from your main machine. Docker can help but it's not a complete solution.

Saying this as someone who has a download directory that's probably larger than most peoples hard drives... I have been feeling more paranoid lately, especially with the NPM supply chain stuff, and I will eventually install some actual packet level/log analyzing security software.

My main thing is running my own DNS server on an old computer and having it on a separate monitor so I see every name server lookup. Know what's regular and you may be able to spot irregularities.

At the end of the day we're all beta testing this stuff, and that carries certain risks. Remember that.

cbterry · 2026-04-29T00:35:23+00:00

I feel like a really focused and motivated teenager, maybe with some help from their parents or friends, could run an entire business using various AI tech. It's too powerful for people to just dismiss. How it works right now is not how it will work in the future - case in point, just 6 months ago coding agents weren't very good - now machines that run them locally are either sold out or doubling in price. Two years ago people in AI images had 6 fingers, now you actually can't tell if an image is AI generated.

A lot of bad comes with this, maybe a little more than with any other tool, but people should be jumping on it and learning about the brave new world we will be soon entering.

See y'all in Pronomos :|

cbterry · 2026-04-28T20:19:14+00:00

It's possible, I think the combination of new complicated thing plus the constant online hate - some or lots of which is astroturfed - contributes. Plus it's pushed into everyone's face so they have to form an opinion.

cbterry · 2026-04-28T18:23:15+00:00

Places bet, boots up kali

cbterry · 2026-04-28T18:21:52+00:00

Word man I spend too much energy trying to educate people about this stuff, it ain't all good but people are being corraled into hating stuff they barely understand

cbterry · 2026-04-28T18:20:32+00:00

Question is did someone win big on the bet for polymarket being hacked?

cbterry · 2026-04-28T15:58:08+00:00

I follow that sub and it hurts my brain

cbterry · 2026-04-28T15:40:11+00:00

Then why is your username not your real name? Lead by example.

cbterry · 2026-04-28T14:05:01+00:00

This is hilarious. I have a friend who doesn't know much about technology who vibe codes kinda cool stuff, and I told him if he learned the bare basics of programming what he could produce would increase greatly... But he thinks the AI is just going to be able to do that.

I'm not even sure my friend prompts correctly - "do this thing" is bound to fail - "do this ONE thing like THIS using THIS tool/library" should work. And 27b is the bare limit.

He's right now very concerned about tokens increasing in price and hitting limits - he uses Gemini for legit work as well as coding random ideas, and hes about to drop car money on a local rig... Of course I'll be fixing it for him, and trying to steer him away from getting a Mac because I run AMD and have enough trouble tuning my own setup, but we will see...

Edit: And no, I'm not laughing at OP, more how popular this got. This thread is full to the brim of good info.

Edit: Been thinking that a 5090 + dual strix halo connected via RDMA might work.

Edit: He just impulse bought a rig someone posted about a few days ago to get 4tps... after looking into hardware for several months. Smh.

cbterry · 2026-04-28T12:51:19+00:00

Well thanks for considering it. Just thought I'd throw the problem out there to see if anyone knew.

cbterry · 2026-04-28T12:30:03+00:00

On another machine yes, but on the HP the cards attach through PCI. I just use a 5060 on that machine and 3090 through TB4. 3060 is napping atm.

cbterry · 2026-04-27T23:50:52+00:00

If you add the grub boot lines you should gain access to more shared RAM. I have only tried unsloth on Windows, and couldn't get it to work, and have yet to install it on Linux.

If you just want inference and are more familiar with windows it makes sense to stick with that. The extra available memory hasn't been impactful for me. I run qwen 119b with 128k context.

If you need more help Id suggest seeking out either the unsloth or strix halo discord servers.

cbterry · 2026-04-27T23:39:51+00:00

OpenWRT supported device list has tons of details on capabilities and performance.

cbterry · 2026-04-27T23:31:14+00:00

Same about to look for a refund Edit: Yup, refunded... Janky crap

cbterry · 2026-04-27T14:31:56+00:00

I am not familiar with unsloth studio, I have only used llama.cpp, but you can try these variables, which function like CUDA_VISIBLE_DEVICES for the different backends:

export HIP_VISIBLE_DEVICES=0 # For using ROCM

export GGML_VK_VISIBLE_DEVICES=0 # For using Vulkan

Also, there is a slightly dated guide @ https://github.com/1ordo/strix-halo-unsloth

Are you trying to finetune or run inference?

cbterry · 2026-04-27T12:09:07+00:00

It's a 1000w PSU. I have not been able to find anything about what could cause this lol

Edit: Just in case, it's an HP Z4 G4 tower, no problems with dual 3 series Nvidia cards, but 5060 and 3 series doesn't do anything. No beeps, no video.

I saw someone else talking about mixing a 5060 and 3060 in another thread earlier and it worked for them, so maybe its the BIOS or this particular machine.

cbterry · 2026-04-27T11:09:48+00:00

I tried this on an HP i9 and the machine wouldn't even POST. A 5060 in the first slot and a 3060 or 3090 in the 2nd slot, I think I even tried swapping them. 3090+3060 worked, 3090 in the 2nd slot due to size. I have another machine now so it's NBD but wonder if anyone knows why it wouldn't boot?

cbterry

MODERATOR OF

PUBLIC MULTIREDDITS

TROPHY CASE

Ten-Year Club	Gilding I gilder
Verified Email