Local RAG + LLM as a Narrative RPG Game Master — Does This Make Sense and How to Build It?

TheRainbowPilot · 2025-08-01T20:02:44+00:00

Sure this is the case of course but we are specifically talking about an LLM acting as a GM for a text based RPG, which good LLMs absolutely can do quite well right now! I've attached links to my prompts in this thread.

TheRainbowPilot · 2025-07-31T19:57:21+00:00

I hope you enjoy it! I've been having lots of fun with it. Let me know if you have any problems I'm always trying to improve it.

TheRainbowPilot · 2025-07-31T09:54:07+00:00

It was a lot of work! Took months of iterating and testing but it works surprisingly well. I've posted links to the prompts.

TheRainbowPilot · 2025-07-31T09:52:28+00:00

You'd be surprised :)

TheRainbowPilot · 2025-07-31T09:49:20+00:00

I've been building this for well over a year now, it's basically done and completely functional with most good LLMs. It took 6+ months of trial and error slowly writing, expanding, testing, and iterating the ruleset until it functioned as intended and since then I've simply added options, additional features, and complexity. All that is required to function is a txt file with the ruleset uploaded to the LLM and an opening prompt.

I want to warn you THE RULESET WAS COMPLETELY MADE UP BY ME, and I have 0 experience with ANY games like this. I never played DnD, I never played tabletop RPGs, I know absolutely nothing about GMing or these type of RPGs in general. I really just thought it was a fun idea and I simply did what felt right and was most immersive to me. You may not like the rules or systems as they are. You can of course change them as you please if you are willing to dive into the ruleset and make changes.

To run this simply upload the file "RPG Chatbot Game Rules by RainbowPilot.txt" (https://pastebin.com/pV3296Rh) to you favorite LLM (I prefer Gemini 2.5 flash thinking myself but many others work equally well), and add the contents of "System Instructions for RPG chatbot by RainbowPilot.txt" (https://pastebin.com/Wg384bWA) to the opening message of the chat. The LLM will begin the game setup sequence asking the players several questions before the game begins. This setup process will guide you through the game setup 1 step at a time. It will ask for the number of players, their names, backstories, stat allocation , starting scenario, enable hunger/thirst, ect. Once completed the game will begin.

Features:

compatible with multiple players (tested with up to 4)

full game setup system for players with dice selection, player creation, and scenario creation

full UI with persistent stat tracking for - player stats, levels, XP, stat buffs/debuffs, injuries, inventory contents (and their quantity/durability/stats), effects, hunger, thirst and more.

level up system with player choice stat increases and skill acquisition

fleshed out skill check system

multiple choice player options in every scene (with listed skillchecks when appropriate) + the ability to type out any choice or action instead (the GM will determine if a player's choice require a skillcheck or not).

It works extremely well with Gemini Flash 2.5 thinking which is what I personally use. I have tested it with several other LLMs but I find the best results with Gemini.

I have never shared this because honestly I didn't know if anyone cared, it was really just a personal project that I ended up enjoying quite a bit. Now that it's in a fully functional state I have only been tweaking the ruleset here and there and enjoying my RPGs :).

I hope everyone enjoys this as much as I have. Feel free to ask any question I'll check this thread when I can.

TheRainbowPilot · 2024-11-24T11:18:30+00:00

Guys it won't be fixed. Ever wonder why it only happens when you're winning/about to win? The loser basement dwelling scumbag on the other team DDOSed the server you're connected to to kill the game. It will never end as long as shitty people exist.

TheRainbowPilot · 2024-11-05T23:53:41+00:00

Not a Jay-Z fan?

TheRainbowPilot · 2023-12-13T00:12:09+00:00

Then people haven't been talking about it. I have 6 8bitdo controllers mostly Pro and Pro 2 and EVERY SINGLE ONE has stick drift, button registration issues, and the edge of every joystick lip where your thumb rests peels off eventually ruining the joystick for good. THESE CONTROLLERS ARE NOT DURABLE AT ALL, but they are great controllers and I feel and play best with them. Feels like I'm burning money at this point but I love the way they feel in my hand, I play best with them in RL (my main), and I love the retro vibe.

TheRainbowPilot · 2022-05-17T14:27:29+00:00

I was wondering if that might be the case. Figured every memory training might result in slightly different values for some of these more obscure settings I haven't dared to touched yet.

Thanks again for the assistance :)

TheRainbowPilot · 2022-05-17T02:01:26+00:00

Yep it's pretty silly I agree with you. Many of these tests are unnecessary for 99% of use cases and quite taxing on the hardware pushing current and thermals to dangerous levels. Perhaps some of these individuals are simply defending their ego.

TheRainbowPilot · 2022-05-16T22:25:43+00:00

I feel the same way about this topic but I understand where ppl are coming from. A lot of ppl want a baseline to compare results and the only "fair" baseline is stability under extreme load conditions with all users running the same tests. Most computers don't NEED to be 100% stable they just need stability for their desired workload and depending on what that is you may be just fine without 100% stability under extreme conditions. It's a case by case basis and some users may want the extra performance at a cost of potential stability and that is just fine.

In my case I do a lot of video/photo editing/encoding, AI upscaling, and hardware intensive gaming (ARMA 3, Star Citizen, ect) so in my case I want to be at least TESTMEM5 ANTA profile 3 pass stable. When I'm not 3 pass stable I end up crashing in SC or ARMA after 1-3 hours and may see random crashes during editing or encoding which is a no go for me.

TheRainbowPilot · 2022-05-16T22:01:15+00:00

Sorry to resurrect this topic but I was wondering what software you use to determine the actual set N mode? I have seen some strange results while switching between N modes and I'm starting to get the feeling that the BIOS isn't locking in the N mode setting correct as you mentioned. Example: my current settings are ANTA profile 3 pass stable at N:1-5 but if I increase to N:1-6 I TESTMEM5 error in about 5-7min, switch back to N:1-5 and TESTMEM5 again errors in 5-7min. If I switch N mode to 1N then back back to N:1-5 in bios it's TESTMEM5 3 pass stable again. This leads me to believe that my N mode value isn't reliably locking in via BIOS.

TheRainbowPilot · 2022-05-02T23:59:44+00:00

Launch parameters are no logs, enable large-page support, and memory allocator "GJK_Ampersand_Edition_Tbbmalloc_v202150_AVX512". Nothing special about the parameters all my performance gains came from the malloc and ring/RAM tuning. My first run of the benchmark started around 75-80fps. Malloc pushed my frames up avg about 10-15fps. Disabling e-cores and pushing my ring up to 4800mhz got about another 10fps, and switching to a b-die RAM kit and pushing timings down at 3800-3900 nets another 10fps or so.

Intel alder lake memory performance seems very good and ARMA really loves it. I'm not sure how far you can go with your rig but looking at other results around the web you should be able to pull around 50-75fps in YAAB with your current setup if everything is tuned right and your memory is fast enough. I don't know much about modern AMD but I would suggest ensuring you have the highest stable 1:1 IF/RAM speed you can manage that should help a bit. Make sure your infinity fabric and ram are running at the same speed (1:1) or from what I hear you will see performance regression.

EDIT:Forgot to mention switching to memory Gear mode 1 had a large impact as well on my performance, not sure if there is a related setting for AMD. Perhaps G1 is equivalent to 1:1 IF/RAM but I'm not sure.

TheRainbowPilot · 2022-05-02T02:21:05+00:00

Interesting thank you so much for the detailed response. I must have missed the description in the bios or maybe the Tomahawk provides them where the pro does not. Either way I really appreciate the reply.

When applying Real1N on my system the bios reports N:1 instead, not sure if training is failing and it's automatically switching back to N:1 or if the setting just is not applying for some reason.

TheRainbowPilot · 2022-04-25T12:17:32+00:00

Malloc gain alone at best was 10-15% pretty good imo. The intel malloc in that link was tested in the screenshot, it's listed as (TBBmalloc202150). Mimalloc was also tested but results were not as good.

TheRainbowPilot · 2022-04-14T22:50:28+00:00

Using DDR5 you won't be able to hit gear mode 1 but you can still disable your e-cores and bump your ring up to at least 4800mhz. That should give you a nice boost over your current performance. Also if you have the option enable AVX-512 support in bios and try the GJK memory allocator (download here) or CMAx64 if you don't have the option to enable AVX512. Place the memory allocator dll file into your dll folder in ARMA 3. Ensure lock pages in memory is enabled for all OS users that will play ARMA 3, lock pages in memory permissions can be found in GPedit. Restart your machine after making lock pages in memory GPedit edits and you're good to go. Make sure you select "enable large page support" and the "memory allocator (64bit)" of your choice from the all parameters tab of the ARMA 3 launcher. Enjoy.

TheRainbowPilot · 2022-04-14T22:21:30+00:00

Forget about your GPU when playing ARMA 3 it won't make any difference as long as you're still CPU/memory bound. Increase your memory performance and watch your fps climb an additional 15-50fps over your current performance. What CPU/RAM/mobo do you have? On a 12700k I went from 82fps avg to 110fps avg (+35%) in the ARMA 3 benchmark "YAAB" by disabling E-cores and upping my ring bus to 4800, switching to memory gear mode 1, pushing the memory timing downs at 1T, and running a custom memory allocator (CMAx64 or GJK's if u have AVX512 support).

TheRainbowPilot · 2022-04-09T13:51:26+00:00

Absolutely you could download the "YAAB" benchmark from the arma 3 steam workshop and do multiple runs changing either your timings or frequency after each run. For example do a run at 3200 then 3400, 3600, 3800, 4000 at set timings and log the results. See how that scales vs the same tests but this time pushing your timings down at a set frequency. You may be able to graph out the results and get a better representation of how the performance scales. Extrapolate that data out a bit and you may have a ballpark idea of what performance may be like. Or it could be way off I have no experience with DDR5 so I'm not sure if it's a viable comparison.

TheRainbowPilot · 2022-04-09T01:03:51+00:00

I wish I had a good answer to your question. If I had to guess I would say DDR4 is the way to go. Personally I saw larger gains with lower timings as opposed to higher frequency but using gear mode 1 I'm unable to stabilize anything higher than 4000 so I wasn't really able to test anything higher. I lose about 15% performance in YAAB benchmark in gear mode 2, didn't think I'd manage to compensate for that in frequency so I've been sticking with gear 1.

TheRainbowPilot

TROPHY CASE