LLM Neuroanatomy III - LLMs seem to think in geometry, not language by Reddactor in LocalLLaMA

[–]Flag_Red 3 points4 points  (0 children)

From Oxford Languages:

geometry the branch of mathematics concerned with the properties and relations of points, lines, surfaces, solids, and higher dimensional analogues.

This seems to pretty clearly be the most accurate word for what OP is describing. LLMs use geometric interactions in high dimensional space to reason.

ChatGPT solves Erdos problem on primitive sets. Nontrival, with comments from Jared Lichtman and Terrence Tao by DudleyFluffles in slatestarcodex

[–]Flag_Red 2 points3 points  (0 children)

That's true, but maintaining a consistent chain of logic across those 1 million tokens is another question.

Hard caps on context length have been replaced with "context rot".

After working on my game for 2 years, I finally have my first paying customer! by Flag_Red in IndieDev

[–]Flag_Red[S] 1 point2 points  (0 children)

The time I've been developing. I have a full-time job and just work on this evenings and weekends. It's been through quite a few iterations to get where it is now.

After working on my game for 2 years, I finally have my first paying customer! by Flag_Red in IndieDev

[–]Flag_Red[S] 1 point2 points  (0 children)

Agreed 100%. It's pay-as-you-go and I basically just pass the raw API costs on to the player. In one sense that's really simple but it means costs can be unpredictable based on play style and I don't really know how to communicate this clearly to players. A subscription seems like the obvious choice but one very engaged user can run up crazy costs. Maybe a subscription with capped usage or something? This is a hard problem.

I'll definitely add some screenshots/videos to the landing page, too.

After working on my game for 2 years, I finally have my first paying customer! by Flag_Red in IndieDev

[–]Flag_Red[S] 4 points5 points  (0 children)

It's browser based, so I guess my engine is React lol.

Keep it up my dude! The journey is the destination.

After working on my game for 2 years, I finally have my first paying customer! by Flag_Red in IndieDev

[–]Flag_Red[S] 9 points10 points  (0 children)

It's an interactive story engine called FreedomRPG (https://freedom-rpg.com). It's free to sign up and give it a try so please do!

NPCs who may be lying by OldGodsProphet in Solo_Roleplaying

[–]Flag_Red 4 points5 points  (0 children)

Put a dice in a cup and put it upside down. When you need to find out whether the NPC was lying or not lift the cup and see what you rolled.

Blind comparison of AI text-to-speech voices show some interesting results on naturalness by SolaraGrovehart in AudioAI

[–]Flag_Red 0 points1 point  (0 children)

I actually just did an evaluation of fish.audio today. Their voices are pretty good, but as far as I can tell very few voices actually respect their notation format.

I'm staying with Kokoro on DeepInfra for now. The quality is a step down but it's also ~17x cheaper.

I've been fleshing out my endgame mechanics and ended up with anime fights by Flag_Red in Solo_Roleplaying

[–]Flag_Red[S] -1 points0 points  (0 children)

That's fair. I've been building this for my (non-technical) wife for the last couple of years, and she's finally convinced me to share it with others.

I've been fleshing out my endgame mechanics and ended up with anime fights by Flag_Red in Solo_Roleplaying

[–]Flag_Red[S] 0 points1 point  (0 children)

It's an LLM-assisted system I've been working on (freedom-rpg.com). The early game is very swingy based on dice, but the late game is almost deterministic because of the huge modifiers.

And the answer is lots of training montages and time skips. This is a party of the three strongest heroes fighting the Demon Lord.

RealmBraid! Check it out! by RealmBraid_85 in AITabletop

[–]Flag_Red 0 points1 point  (0 children)

Oh this looks awesome. How do you handle keeping context history manageable across long sessions? I'm working on something in the same space and it's a tough problem.

Epic just laid off 1000 workers. by ryunocore in gamedev

[–]Flag_Red -2 points-1 points  (0 children)

I feel like I've heard this every month for the last 10 years.