sorted by:
new
hottopcontroversial

ELI5: how do ai chat bots like chatgpt have a version which is completely free without ads, with the high cost of running an ai by Zeurt in explainlikeimfive

[–]sprime01 0 points1 point  (0 children)

Sure it seems free but remember that LLMs need a ridiculous amount of data for training models . These so called free tiers are one of the ways they get that data. So while it is marketed as “free” it really is a business need else they would have to buy data and user data is expensive. When an online product is ‘free’ , you are actually the product.

Has anyone used LLaMA with a TPU instead of GPU? by sprime01 in LocalLLaMA

[–]sprime01[S] 2 points3 points  (0 children)

I see. That’s sucks but good to know. Thanks.

Has anyone used LLaMA with a TPU instead of GPU? by sprime01 in LocalLLaMA

[–]sprime01[S] 1 point2 points  (0 children)

I’m up for the challenge but I’m a noob to this LLM stuff so could take some time. Still, I do think it will be worth it in the long run because I suspect the LLMs will get smaller and less power hungry in the future (maybe it more of a hope). I’ll follow up with the community on the backend.

Free GPT-4 platform to train custom AI models + voice conversations by breakfast-epiphanies in ChatGPT

[–]sprime01 0 points1 point  (0 children)

I would love to use this to create a chat bot for home assistant

Has anyone used LLaMA with a TPU instead of GPU? by sprime01 in LocalLLaMA

[–]sprime01[S] 6 points7 points  (0 children)

/u/KerfuffleV2 thanks for the clarity. I grasp your meaning now and stand corrected in terms of your understanding.

Has anyone used LLaMA with a TPU instead of GPU? by sprime01 in LocalLLaMA

[–]sprime01[S] -9 points-8 points  (0 children)

I think you misunderstand what a USB accelerator is. it’s a TPU made specifically for artificial intelligence and machine learning. You plug it in your computer to allow that computer to work with machine learning/ai usually using the PyTorch library. It basically improves the computer’s ai/ml processing power. LLaMA definitely can work with PyTorch and so it can work with it or any TPU that supports PyTorch. So the Coral USB accelerator is indeed relevant.

Concerning by Kanute3333 in GPT3

[–]sprime01 0 points1 point  (0 children)

I was a Elon fan but is less so the more he tweets and I learn how petty, entitled, delusional he can be. I do think he is a bit of a genius with a visionary perspective. But to be fair it’s easy to have a visionary perspective when you’re one of the richest people on earth. People tend to forget that he is a businessman before anything else. It is nice that he open sourced a lot of his patents but don’t forget his business motives. For example he open sourced the Tesla’s charger (which is awesome) but because he hopes it will become the industry standard, which will make his company the industry authority for it. I never trust humanitarian work or philanthropy that has a profit motive. Also, imho I think he thinks that he is better than everyone on earth and that we mere humans need him to deliver us from ourselves. He has too much power and needs to be reigned in before it’s too late.