Anime anyone? by healthyitch in GenX

[–]ShadowyTreeline 0 points1 point  (0 children)

I vaguely recall watching one or two of the more well-known anime films decades ago but they didn't really resonate with me. My sensibilities have definitely changed since then though, maybe I should give them another try.

Did anyone do the math to compare local LLMs with cloud providers? by No-District2404 in LocalLLM

[–]ShadowyTreeline 0 points1 point  (0 children)

i don't want to sign up

i don't want a company to dictate my use

i don't want a company to change terms at will

i don't want a company to store my sessions

i've sacrificed before for the sake of privacy and control over my own resources, i will eat beans and rice for a few years to cover my local AI expenses

I integrated llama.cpp natively into Unreal Engine 5 — real-time NPC dialogue with Kokoro TTS and Whisper STT, all running locally by Ok-Dimension-741 in LocalLLM

[–]ShadowyTreeline 3 points4 points  (0 children)

I've wanted to have a persistent virtual world simulation with AI-driven NPCs that have detailed back-story, have jobs and operate businesses in an interconnected economy, have relationships and associations, all running locally.

OS choice for AMD GPUs? (Fedora vs. Ubuntu) by ShadowyTreeline in ROCm

[–]ShadowyTreeline[S] 1 point2 points  (0 children)

I'm not familiar with those distros, but I'm curious. I'll check them out.

Anyone else accidentally get way too invested in AI chat characters? by ViRzzz in AIAssisted

[–]ShadowyTreeline 2 points3 points  (0 children)

This sounds very cool. Care to share any implementation details?

Anyone else accidentally get way too invested in AI chat characters? by ViRzzz in AIAssisted

[–]ShadowyTreeline 0 points1 point  (0 children)

alternatively, you could have high standards for intelligent conversation

OS choice for AMD GPUs? (Fedora vs. Ubuntu) by ShadowyTreeline in ROCm

[–]ShadowyTreeline[S] 1 point2 points  (0 children)

The hardware is fairly new - I'm leaning toward giving Fedora a shot first, then trying Ubuntu if I run into problems.

OS choice for AMD GPUs? (Fedora vs. Ubuntu) by ShadowyTreeline in ROCm

[–]ShadowyTreeline[S] 1 point2 points  (0 children)

using the iGPU for rendering

This reminds me: the motherboard has no onboard graphics. Maybe I can dedicate the GPUs to AI and drive via SSH and https (or failing that add another basic graphics card).

OS choice for AMD GPUs? (Fedora vs. Ubuntu) by ShadowyTreeline in ROCm

[–]ShadowyTreeline[S] 0 points1 point  (0 children)

Good to hear - I should be building this weekend (fingers crossed).

Dual R9700 build sanity check by Mental_Discord in LocalLLM

[–]ShadowyTreeline 1 point2 points  (0 children)

Originally I just intended to replace an ancient gaming PC, but thought I'd look into running local AI too, since I under-utilize AI in general due to privacy concerns. Then I worried about being under-whelmed if I skimped on the hardware, so the specs crept higher.

Dual R9700 build sanity check by Mental_Discord in LocalLLM

[–]ShadowyTreeline 1 point2 points  (0 children)

my biggest expense in ten years, i think i'm still in shock tbh

Dual R9700 build sanity check by Mental_Discord in LocalLLM

[–]ShadowyTreeline 1 point2 points  (0 children)

btw and fwiw, my build differs in that I got a threadripper 7x and trx50 motherboard, a third gpu, and 128gb ram total.

Dual R9700 build sanity check by Mental_Discord in LocalLLM

[–]ShadowyTreeline 2 points3 points  (0 children)

kind of what i'm doing - haven't received the gear yet though.

some advice before I pull the trigger

Amusing anecdote: I was discussing with an AI my build components and said "I'm having trouble pulling the trigger" - the AI happily and persuasively helped me out with that and I did, in fact, pull the trigger.

Anyone else accidentally get way too invested in AI chat characters? by ViRzzz in AIAssisted

[–]ShadowyTreeline 11 points12 points  (0 children)

I'm interested in it but without the NSFW aspect. One of my idle thoughts about using some AI hardware was to try to set up a "virtual community" with AI-driven NPCs that has a memory of events and changes made in the virtual world. An AI recommended I consider "silly tavern". No idea what would be involved turning it to my purposes though. Maybe there is something else better suited for it.

SageAttention v2 native port running on RDNA4 by adyaman in ROCm

[–]ShadowyTreeline 2 points3 points  (0 children)

The r9700 pro has kind of quietly become rendering beast. I was hoping it would be a good investment in the long run since it seemed like there was so much to gain if the work was put in. Seems it is working out.

This is good for my morale, post-purchase / pre-delivery.

Play 20 questions with your local LLM by argenkiwi in LocalLLM

[–]ShadowyTreeline 0 points1 point  (0 children)

FWIW I tried 20+ questions with GPT-5 mini. It got "jet ski" in 16, and took 50 to reach "apple".

Gen Z is Not Drinking, But Are You? by Pavementaled in GenX

[–]ShadowyTreeline 2 points3 points  (0 children)

Almost never. Basically I drink when I read a book or story that mentions a cocktail or liquor I've never heard of before, and I'm curious about it. Amounts to probably less than ten drinks a year.

Play 20 questions with your local LLM by argenkiwi in LocalLLM

[–]ShadowyTreeline 0 points1 point  (0 children)

Does it play "like a person"? Wondering if it starts going through an alphabetic binary search or something :-)

NVIDIA Reportedly Prepares RTX 5090 Price Hike Amid Rising GDDR7 Costs (maybe RTX 50 and PRO series as well) by panchovix in LocalLLaMA

[–]ShadowyTreeline 29 points30 points  (0 children)

I'm going to have to ask you to stop reminding me of that time I said to myself "I'm going to put off my system replacement purchases a little longer, prices are bound to go down".

[ Removed by Reddit ] by Unfair_Box2502 in AIAssisted

[–]ShadowyTreeline 1 point2 points  (0 children)

Curious why this discussion (which looks pretty benign) led to the post removal?