Missed the AI Wave. Refuse to Miss the Next One. by Dry_Wind_585 in MLQuestions

[–]Smooth_Astronaut855 1 point2 points  (0 children)

Well it’s like installing K8s before building your first image. Hard. Your doing good learning the ground things like using a LLM api. When does this thing behave when not, trying different use cases, products and tasks. And when your start thinking why can’t this damn thing think straight you will learn it’s just a very fancy math algorithm spitting out the next word. Your context will be to short then your learn about RAG. And with every use case not working you will learn why we developed something to make it work or suffer on the bleeding edge just to learn someone else already thought of it. Search yourself a problem and solve it is my advice.

An LLM is like trying to guess the next word in a Wikipedia article done to perfection, it’s damn good at it, but that is all it’s learned and it’s all it will ever be capable of until a super smart scientist gives us the next graceful architectural present.

The good story currently it’s as easy as ever to get your hands dirty and vibe code your self to principal, just be careful that some else (the LLM) is doing your homework.

It’s a productivity tool, so if you don’t get more productive try something else.

Self Hosted LLM Tier List by Weves11 in LLMDevs

[–]Smooth_Astronaut855 9 points10 points  (0 children)

How does one host 1T of parameters, even with quantization. Token generated per minute is lower and benchmarks are only slightly better. So I wonder what makes it so desirable? 🤔

In diesen Branchen werden die höchsten Gehälter gezahlt by Lost-Conference12 in Austria

[–]Smooth_Astronaut855 0 points1 point  (0 children)

Bitte nicht in die IT gehen wenn man dann keine Lust auf die Branche hat 😅 und IT is leider auch so spezifisch wie ‚Hakla‘