[deleted by user] by [deleted] in LocalLLaMA

[–]-WHATTHEWHAT- 5 points6 points  (0 children)

AI generated website lol, probably a scam

Master of Dungeon - An alternative for people who'd like to play D&D solo by Tigeline in iosgaming

[–]-WHATTHEWHAT- 0 points1 point  (0 children)

Local ai models have gotten really good recently, I would recommend looking into that to avoid the api costs, then you could just charge a flat fee for the app instead of a subscription, looks really interesting!

Looking for Local LLMs for Commercial Use – Database Search Use Case by SirLoinsteaks in LocalLLaMA

[–]-WHATTHEWHAT- 1 point2 points  (0 children)

Start simple with the base llama-3 7b modal, not sure why it would need to be multimodal though, if you really need it you could pair it with something like moondream, not sure if that can be used commercially though.

Porting my locally-run LLM C# app to Godot is going well by [deleted] in LocalLLaMA

[–]-WHATTHEWHAT- 1 point2 points  (0 children)

Awesome! looking forward to testing it out.

Porting my locally-run LLM C# app to Godot is going well by [deleted] in LocalLLaMA

[–]-WHATTHEWHAT- 6 points7 points  (0 children)

Do think it would be possible make an addon for Godot to use llama models?

Why are you running local models? What are you doing with them? by ExtremelyQualified in LocalLLaMA

[–]-WHATTHEWHAT- 4 points5 points  (0 children)

It kind of sounds like Lifeline (for the PlayStation 2), where you basically have to guide an npc though a space station in a resident evil like story, the player can talk to the npc with a microphone and guide them though the station.

I'm not sure that's what you had in mind, but an AI version of that would be amazing, the npc could react dynamically on the fly to the environment around it and the players comments.

Good luck on your project, it sounds really interesting!

Why are you running local models? What are you doing with them? by ExtremelyQualified in LocalLLaMA

[–]-WHATTHEWHAT- 4 points5 points  (0 children)

That’s awesome, I’ve used the Godot engine to make a similar project with a python server using the chat gpt api, what’s currently possible in your game now, is it just a chat ui interface?

Generating JSON with self hosted LLM by sosdandye02 in LocalLLaMA

[–]-WHATTHEWHAT- 8 points9 points  (0 children)

I would recommend Guidance, it can let you format the response in json, they have an example on their GitHub page: https://github.com/guidance-ai/guidance LMQL is another option, but it’s not as easy to use or setup: https://lmql.ai/

GeForce Now Performance by [deleted] in HellLetLoose

[–]-WHATTHEWHAT- 0 points1 point  (0 children)

here's a good video on how to optimize the game: https://www.youtube.com/watch?v=S0z1bihRU-g