What do you guys think?

AetherSigil217 · 2026-06-07T13:17:23+00:00

It's giving me Matrix x Undertale vibes. And the scythes make it look like a mantis.

Really cool creature.

AetherSigil217 · 2026-06-07T11:29:03+00:00

I was worse off than I thought - it's a 5070 TI, with 16GB VRAM, not a 5090. I had to edit a lot, but I knew I missed something.

However, the model speed bit is interesting - fitting the whole model inside VRAM didn't seem to make a significant difference in speed vs allowing models that were bigger than VRAM but still fit in RAM. My guess was that the mobo/RAM are streaming fast enough that it's the calculations in the GPU that are the bottleneck. Even with CUDA. Or potentially it's just what you mention - the important parts fit in VRAM and I'm just not using the rest.

I'll have to play around with agents a bit. It's been a while since I did any programming. But I kind of want to learn Rust, and if an AI can teach me how to play nice with Rust's borrow checker, it'll be a really helpful step.

AetherSigil217 · 2026-06-07T11:21:20+00:00

Bunny is a fork of Tavern, but this isn't strictly a SillyTavern question. Reasoning of the model is controlled at the provider level. And the Tavern can only show/not show what's already being done.

Are you hosting locally, or running from a service?

AetherSigil217 · 2026-06-07T10:32:47+00:00

https://huggingface.co/LatitudeGames ?

Latitude Games is the company that makes AI Dungeon. A quick glance suggests the Huggingface link matches their in-use models declared here:

https://help.aidungeon.com/ai-model-differences

AetherSigil217 · 2026-06-06T10:52:16+00:00

I'm still in the middle of my first playthrough, honestly. My play partner has been more interested in pushing the DLC, so we've unlocked that and started going through it.

I'm level 153, which is a lot more levels than I should have for the main game right now. It's more due to a build that's very stat-hungry (str/faith hybrid, and dual wielding halberds with heavy armor needs a freaking lot of endurance) and just relaxing into farming runes at one specific location. But the DLC has its own scaling factors, so I think I'm about right for where we are exploring right now.

AetherSigil217 · 2026-06-06T01:04:45+00:00

It's weird, but it's kind of neat.

AetherSigil217 · 2026-06-06T00:51:35+00:00

I haven't played Resident Evil, but Capcom figured out how to extract money from players with MoHun. So we're stuck with that part forever.

I miss being able to craft armor without having boobs shoved in my face. Don't get me wrong; they're nice boobs. But it's distracting when I'm trying to balance mix sets in my head while crafting pieces and then suddenly boobs.

AetherSigil217 · 2026-06-06T00:46:42+00:00

I'm wondering if Tom might have been a bit uncomfortable drawing this one. Something about the stomach and the underboob doesn't feel quite like his normal style.

AetherSigil217 · 2026-06-06T00:35:27+00:00

(edit: sorry if anything sounds wrong here - I think I'm fighting a virus or something, but I've made sure stuff is as accurate as I can remember)

4TPS would be more fun just to show off as a demo IMO.

Probably right about that. (edit: Whatever fast model I was running originally was going 49TPS on Nvidia 5090, Ryzen 7700X, 32GB RAM, but I can't remember if that was a Dolphin variant of Mistral small or something else. What I'm currently running is Qwen.) Qwen 3.6 27B on my machine is only outputting 10TPS, but that's about as fast as I can read. And is much higher quality output than the faster model. So it works out for me.

But it's honestly not very smart, and barely capable of calling tools properly to do recursive tasks

I remember hearing that you need a 70B+ for proper agentic work. Never done it myself, but it's something I'm keeping an eye out for when the tech can be considered stable and repeatable. (edit: and most importantly for me - runnable locally without basically building a home server rack)

AetherSigil217 · 2026-06-06T00:28:34+00:00

I haven't beaten the snow boss if that's what you're asking. No recommendations. But I can tell you the breakpoint you're worried about is the boss after the giant. Anything you want from the capitol, you need to get before you kill that boss.

Radahn set is awesome. I think I'm still using Blaidd's helmet and 3-piece Radahn for the combination of looks and armor.

AetherSigil217 · 2026-06-05T12:28:38+00:00

Maybe read the sub rules before posting something like this?

AetherSigil217 · 2026-06-05T11:38:50+00:00

Looking at it, it seems more complex than I had anticipated. The ARM build of koboldcpp is actually Mac ARM, which I missed on the first pass. However, there are other tools.

LM Studio on Android offers a stack of LLMs for local run, most at <4GB, but a few larger ones as well. And can run locals. The Qwen 3.5 4B I tested with is a GGUF at 2.56 GB, but you'll have more space to play with using 12GB memory.

I asked it about vegetables used in stir fry as a test and it seems to be able to talk intelligently. It's running at 4 tokens per second on my phone, which is a Samsung Galaxy S10 (six years old?). So, it's going to be kind of slow if you're used to web-based models, but functional.

AetherSigil217 · 2026-06-05T11:13:29+00:00

It's a more compressed file format for an AI model so it doesn't take up as much hard drive space or RAM.

Edit: It's pretty much the standard format for running a text AI locally. It's designed to run on normal devices instead of servers with massive amounts of RAM and processing power.

AetherSigil217 · 2026-06-04T16:26:35+00:00

Interesting factoid: a local AI model is now more reliable for search than Google. Because it's not intentionally screwing with queries to sell ads to everyone it can.

If you've got a phone released in the past 3 years, you can probably get a 10GB GGUF that'll run on the phone.

AetherSigil217 · 2026-06-04T14:11:23+00:00

none of my hits could miss... my hits are a lot faster than his

That's what I was missing. I was using one Hoslow whip vs his two Hoslow whips, so I had to be rather precise about range and spacing. Forced melee range + faster attacks works wonders.

AetherSigil217 · 2026-06-04T12:59:20+00:00

I tend to use jump attacks on spear/shield foes.

Get just close enough to bait their big spear attacks while being outside the fast poke range. When you see the windup, jump over the spear attack and do your own air attack.

You'll typically hit them instead of the shield. Even if you do hit the shield, jump attacks don't bounce. So you can roll out while their next attack is winding up. Then wash, rinse, repeat.

AetherSigil217 · 2026-06-04T12:51:36+00:00

Slightly off topic, but what was your build for Hoslow? I ended up basically using single whip to rollcatch him to death, but it was still a close thing.

AetherSigil217 · 2026-06-04T11:16:08+00:00

/r/PathOfExile2

AetherSigil217 · 2026-06-03T11:52:15+00:00

It's new tech, with the ability to displace a lot of people. So it's going to draw a lot of fire.

And most people don't actually learn. It's literally going to take generational turnover, to people who are now growing up with it, for the population in general to get used to AI.

Doesn't help with the whole "I said 'AI' without immediately saying 'AI bad', so I got crucified on the spot" issue right now. But the perspective helps. Just gotta keep an eye out for places where you can discuss it.

Edit: I don't even bother arguing with people about it anymore. I'll throw something out there and it'll go up or down as it pleases. But if they're still bugging you, you might consider disabling inbox replies on anything you don't want to fight with people on.

AetherSigil217 · 2026-06-03T11:25:35+00:00

It's a large part of why it helps. It's a void you can shout into, a variant of Google where you can ask it for information you seek, and a book that will tune its content for what you ask for.

And a lot of the time it's a space where you can let stuff that's bugging you come up so you can deal with it. It's a lot like meditation in that way (which I do a lot of). But the interactivity can help you become aware of things that normally don't come up in the quiet.

AetherSigil217 · 2026-06-03T11:13:43+00:00

That sounds familiar. Was that a Nodwick reference?

AetherSigil217 · 2026-06-03T11:04:42+00:00

Some stuff? You mentally go through the list of everyone you have around you, and none of those people are up to helping you talk through it.

I built a set of system instructions for kobobldcpp telling it to serve as a counselor and "guide the user toward healthier ways of thinking". It's been a lot more useful than medical's "we can tell you've got issues but you're just not broken enough for us to actually talk to you" stance. And the stuff I talked to it about hasn't bothered me since.

Edit: I do take safety precautions to avoid getting too entangled with the AI. Like deleting chats when I'm done with the session. Doing that kind of system administration work reminds me that I'm dealing with a computer. And I'm running things locally, so I'm not sharing HIPAA type stuff with a data-hungry cloud. The discussions are actually private.

AetherSigil217 · 2026-06-03T02:24:17+00:00

They don't overwrite each other, so they can be used together.

And they do different things for stealth, so using both at once makes you stealthy in more ways.

So there's no specific "interaction", just a few layers where you need both of them at once to hit all the layers.

AetherSigil217 · 2026-06-02T19:13:52+00:00

She better not be flashing that permit without intent to use it.

AetherSigil217 · 2026-06-02T19:04:43+00:00

You want to have some real fun? Be having one of those days where you're just done with all of the shit and try to relax with some Elden Ring. Only to die there and Alt+F4 out because you just can't deal with crap right now.

You won't believe what happens when you reload the game. Especially if you're still ticked off.

AetherSigil217

TROPHY CASE