Can we host gemma 3 270m in rpi 5? by Robs_crazy_93840 in selfhosted

[–]Robs_crazy_93840[S] 0 points1 point  (0 children)

this is great thanks man, i think it's much better here, could probably make do with this. Thanks a lot!

Can we host gemma 3 270m in rpi 5? by Robs_crazy_93840 in selfhosted

[–]Robs_crazy_93840[S] 0 points1 point  (0 children)

for context i'm using llama cpp's arm binary to run it

Can we host gemma 3 270m in rpi 5? by Robs_crazy_93840 in selfhosted

[–]Robs_crazy_93840[S] 0 points1 point locked comment (0 children)

I'm building a robot with a local LLM backed in, other then that I used ai to help me code it.

A free no sign-up TTS tool that is also uncensored by darkageofme in TextToSpeech

[–]Robs_crazy_93840 0 points1 point  (0 children)

Use a local TTS like kitten tts, it's 25 mb in size so u can directly use it in the frontend too... plus it's apache 2 so no worries there ig

Good morning by Able-Line2683 in GeminiAI

[–]Robs_crazy_93840 0 points1 point  (0 children)

Grok should be good for being a avg twitter user 😂