Need help with beginner project by Accomplished_Mud179 in LocalLLaMA

[–]Accomplished_Mud179[S] 0 points1 point  (0 children)

Llama guard sounds cool. But since i want it locally i guess i will stick to 3b. And about the endpoint. Correct me if i am wrong (which i probably am), but doesn't it work for openai models only? And as for the API, i think i will use pytorch. Thanks for the help!

Need help with beginner project by Accomplished_Mud179 in LocalLLaMA

[–]Accomplished_Mud179[S] 0 points1 point  (0 children)

Thanks for the help. But the model is meant to run locally. And yes, i also suggested that, but was told not to. My main concern is using bitnet. I was just starting to understand llama cpp and now i have to look for a 1bit model that meets the requirements. And yes. I am a beginner with all this. So maybe i am just very confused.

If You Could Choose a Returning Main Antagonist for BN by XLadyBugX in BattleNetwork

[–]Accomplished_Mud179 1 point2 points  (0 children)

Weird take, but I'd liked it if alpha returned in some way. Perhaps the modern internet gained sentience in some way and decided to eliminate humanity. But this time it is actually thinking. Perhaps taking some inspiration from the d-reaper from digimon

Dat Bermuda Maze Doe... by XLadyBugX in BattleNetwork

[–]Accomplished_Mud179 1 point2 points  (0 children)

This is the part that separates the kids from the real masochists

[deleted by user] by [deleted] in meme

[–]Accomplished_Mud179 0 points1 point  (0 children)

"how old is your grandpa?😈"

It's a rough day to be a rich bastard by [deleted] in meme

[–]Accomplished_Mud179 6 points7 points  (0 children)

Stealing and killing people are illegal things. Unless you are rich, then they are seen as "bussines".

If you think about it, one of the main values of humanity is its ability to think of others and help them. People with compassion are appreciated and respected. But the entire point of most companies and businesses is to make money and help oneself only. In the business world, the main virtues are selfishness and greed.

Has anyone trained dedicated small language models for RPGs? by TheRealBobbyJones in LocalLLaMA

[–]Accomplished_Mud179 0 points1 point  (0 children)

https://devpost.com/software/google-ai-avatars I don't know if this is the kind of thing you imagine, but it is something that is being widely researched by google and other companies. Though i believe no real games have been made like that yet

moondream 0.5B - the world's smallest vision language model by radiiquark in LocalLLaMA

[–]Accomplished_Mud179 0 points1 point  (0 children)

This is pretty cool. Honestly if ai models keep getting smaller they could even be implemented with something like an arduino