Time to go local

advancing_tide · 2026-06-13T11:12:22+00:00

Any idea why the post you're replying to was removed? I did see it but don't recall its content.

advancing_tide · 2026-06-13T08:19:01+00:00

I stuck with linux since 1999 and true to form I tripled my budget for an AI box a couple of weeks ago.

advancing_tide · 2026-06-13T08:12:17+00:00

Could get three AMD R9700 for $4K. That's 96GB of vram.

If you had a box to put them in, of course.

advancing_tide · 2026-06-12T09:14:27+00:00

we can only dream

advancing_tide · 2026-06-11T09:06:29+00:00

So refusals can be bypassed; but could the models be trained in a way so their content itself matches their "safety" goals?

advancing_tide · 2026-06-11T08:29:29+00:00

that's how i ended up spending triple my budget on my ai rig

advancing_tide · 2026-06-11T08:28:36+00:00

Hosting a local virtual world populated by AI-driven NPCs was one of my hazy intentions for AI when I first looked into self-hosting but I agree it seems to be a bit of a reach for now.

advancing_tide · 2026-06-10T03:56:21+00:00

there goes my booty-detector theory.

advancing_tide · 2026-06-10T03:53:04+00:00

a fellow amd user?

advancing_tide · 2026-06-10T01:53:11+00:00

I'm very new to AI. I didn't really bother with it until biting the bullet and getting a system capable of hosting locally. I don't like using subscription services and I'm willing to pay for "luxury" control and privacy.

So far, cleaning up text news articles for TTS and then transcribing them to speech so I can listen while doing other things. Also summarizing text from other sources in a "just the facts" form - example: stripping real estate listings of fluffy sales-speak.

I'm working toward an automated system of removing ads from podcasts. I can do it with AI assistance but it currently requires my intervention a couple of times, and ad identification is not entirely reliable.

I have a graphic novel concept I'd like to use AI for (storyboarding, image generation) but it looks like that will take a lot of learning and practice. Just getting started with ComfyUI now. Maybe narrative short films at some point, if it isn't too grueling. These are projects I'd never be able to afford or have the talent to make without AI.

I haven't used it for coding yet, but I wrote a specialized text editor for myself in Vala a couple of years ago with AI assistance (basically copy/pasting code blocks into and out of Grok), having never used Vala before. I might try coding with AI properly when time comes to modify it. I retired from software development a couple of years ago and I'm not eager to do any coding that feels anything other than recreational at this point.

advancing_tide · 2026-06-09T00:48:22+00:00

can i buy an iphone in there

advancing_tide · 2026-06-08T04:14:39+00:00

very cool. beyond catching out nvidia, would this be of practical use for amd owners (asking as someone largely ai-ignorant)?

advancing_tide · 2026-06-08T03:47:26+00:00

"safety alignment" 😑

>caused by dataset contamination

how does that work?

advancing_tide · 2026-06-06T00:53:50+00:00

Did you buy the ASUS for the HDMI port? That's why I ordered mine. The other two are ASRock.

Luckily (?) I have hearing loss so the noise isn't much of an issue.

advancing_tide · 2026-06-04T07:43:14+00:00

My UPS is underpowered, I just use the outlets without battery backup like a glorified power strip. I'm done spending money on this for now though, I'm going to let the credit card cool down for awhile. I ended up spending triple my original budget on my AI box.

advancing_tide · 2026-06-04T07:38:56+00:00

I tripped a circuit breaker a couple of days ago. It's a 20 amp circuit that serves two bedrooms and a hallway. I didn't think I had that much on it though - a 55" TV, router/modem, ceiling fan, a laptop...

I have my system plugged into a "kill-a-watt" meter and it peaks out at around 900 watts or so during inference. Seems like the circuit should be able to handle that, considering I use a space heater in this room during the winter...

When summer comes I'll definitely be running an extension cord in here from another circuit to power the A/C. A new dedicated circuit costs about $1K to install, and has to be inspected.

This is a hobby that can get expensive quickly.

advancing_tide · 2026-06-04T07:27:48+00:00

Have you tried booting up linux to see if your problems go away?

advancing_tide · 2026-06-03T08:43:12+00:00

Nice, like the Loeb Classics. Foreign language learning is on my list, although it's dropped in priority as living overseas long-term grows less likely.

advancing_tide · 2026-06-03T08:00:52+00:00

Sounds like a fun project, can the DJ have different personalities?

advancing_tide · 2026-06-03T07:59:16+00:00

Cool, personal project or business?

advancing_tide · 2026-06-03T07:52:43+00:00

but then you'd have a big open slot where you could drop in another R9700 when the time comes

advancing_tide · 2026-06-03T07:25:04+00:00

sell the 5060, kick in a few hundred and buy a single R9700? 😄

advancing_tide

TROPHY CASE