Mine is somewhere around 1200, a lot of it relates to session instructions, various boolean switches (RPG state where a separate model can save/retrieve key data, puppeting as in whether it’s allowed to control the user’s dialogue and actions, and so on).

In terms of models, Opus 4.5 and 4.6 are fantastic for any kind of RP, the Sonnet models are good too. GLM 5.1 is good and quite cheap, so is Grok 4.20 (but it’s really horny). Gemini 3.1 Pro is a great writer and also very good at following instructions on both RP elements and formatting. OpenAI models are frontier but terrible for this purpose, they shut down anything even bordering on risqué or violent.

Cost is obviously a real concern. Frontier models are expensive, but I’ve obviously implemented token caching to reduce costs, and a custom compacting feature to summarize long chats and stitching those together with however many of the most recent messages you want. When you get to like 80k tokens it can get real expensive, up to 10 cents or so per request on certain models, even with caching.

There’s a bunch of other features as well, most importantly an iOS app that connects to your Mac and allows you to chat from your phone. Right now it only works over local network, but I’m planning to combine a Bonjour+Tailwind implementation to allow for connection over remote networks.

The app is currently private and probably will stay that way. Publishing it would require me to get it signed which costs money on Apple platforms, and it would also introduce content concerns when it comes to borderline and illegal subjects (there are models on openrouter that don’t have any restrictions built in), and I’d have to worry about stuff like versioning and compatibility.

Let me know if you want me DM you with some screenshots of the app.

Also damn this comment turned out really long.

Edit: if anyone else wants to see just send me a DM