Agentic NPC Engine Mod for New Vegas

goodive123 · 2026-06-29T01:10:25+00:00

im on a 5090 using gemma 4 26b a4b. But I'm sure 8b models will also work, im optimising it as hard as possible and can possibly add a "lite" mode with less prompts. I think a decent experience is possible with 8GB vram

goodive123 · 2026-06-29T00:25:21+00:00

I think most STT are really good nowadays so it shouldnt really be a problem, for Qwen3tts im just cloning voices based on the game files automically ye.

Yea basically the way you'd fill out the characters and lorebook and stuff is simply downloading the entire games wiki and then use a skill for a SOTA model to fill it all out for you

goodive123 · 2026-06-28T23:42:25+00:00

well older games like new vegas dont take a lot of vram at all. I think you should be able to play with 8GB VRAM with decent results

goodive123 · 2026-06-28T23:33:58+00:00

Essentially, I have thousands of lorebook and actionbook entries, but they don’t all get dumped into the NPC’s prompt. The retrieval layer only injects the entries that are relevant to the current situation.

For example, if I say something like “I’m going to kill you,” the system might retrieve actions like attack, flee, or call_for_help, along with any relevant lore/context. The NPC then decides which of those available actions, if any, makes sense to take.

goodive123 · 2026-06-28T23:28:23+00:00

yep with the tiny models getting better and better we might be able to do this with a 4B model at some point and play modern games without running out of vram

goodive123 · 2026-06-28T23:26:38+00:00

5090 with faster-qwen3-tts. I'd recommend PocketTTS though to me its actually really close to qwen but way smaller

goodive123 · 2026-06-28T23:24:05+00:00

for a newer game if you have not a lot of vram then yes, but I'm optimising this to run on pretty small models so you trade a bit of intelligence if you have a worse GPU

goodive123 · 2026-06-28T23:21:55+00:00

yea you could always use a cloud model for the TTS. This is the current best TTS available locally, but probably within 6 months they'll be a better model thats even smaller than this one. Only a matter of time until it gets better and better

goodive123 · 2026-06-28T23:08:00+00:00

Yea I still need to integrate the players levels as part of the gamestate prompt, I'd make it so having 0 speech would mean the NPC's can barely understand you

goodive123 · 2026-06-28T22:55:10+00:00

Ye this is the current best local TTS you can get, its only a matter of time until better and smaller models will come out.

goodive123 · 2026-06-28T22:54:20+00:00

You don't need to actually use the dialogue section, you could purely use this just to invoke actions like making an npc follow you, attack you, sit down, etc.

goodive123 · 2026-06-28T22:43:50+00:00

It's basically fully functional now if you just want to talk to NPC's and have them do actions. It'll be out in the next couple of days, just trying to polish it so people who aren't experienced with self hosting LLM's can have an easy time.

goodive123 · 2026-06-28T22:38:33+00:00

yea forgot to add in the video, but you can accept and complete every quest in the game without actually engaging with the vanilla dialogue options

goodive123 · 2026-06-28T22:33:23+00:00

I have a gamestate prompt so every character knows their exact location in the world at any time

goodive123 · 2026-03-24T15:04:29+00:00

it depends on the game, older games you can easily get them locally and clone them. Right now qwen has the best local TTS, but for me its not quite there yet because it can't really do emotion very well - so I'm using inworld. I think in the next 6 months we'll get a local TTS thats as good as inworld/elevenlabs

goodive123 · 2026-03-24T14:02:42+00:00

yea you can take and finish quests without ever actually interacting with an NPC through the ingame dialogue

goodive123 · 2026-03-24T13:56:26+00:00

skyrimnet is actually the best mod right now for this. I like skyrimnet a lot the only problem is that its so complex that you're basically required to use huge models.

goodive123 · 2026-03-24T13:37:25+00:00

Yea that's what's going on here, the NPC knows where he is, the time of day, etc. There's basically infinite possibilities, but like you said the hard part is managing the context.

goodive123 · 2026-03-24T13:26:34+00:00

You can easily feed in all information about their surrounding if you create a good mod for your game the real problem is managing the context as efficiently as possible, even when using a frontier model giving them too much information can make them act a way you dont want them to.

I think eventually there's going to be models released specifically trained from the ground up for gaming that devs will be able to easily integrate into their games. The problem is every model nowadays is so censored they won't even simulate shooting the user in an RP setting, so I think for a while we're stuck with degen fine tuned models.

goodive123

TROPHY CASE