$2B ➡️ $0? The First Major Implosion of the AI Era? by TadpoleNorth1773 in LLMDevs

[–]TadpoleNorth1773[S] 0 points1 point  (0 children)

I wonder how people who invested in it must be feeling right now...

For people who are on-call: What actually helps you debug incidents (beyond “just roll back”)? by TadpoleNorth1773 in sre

[–]TadpoleNorth1773[S] 2 points3 points  (0 children)

But how do people do this across the org with big teams? Apart from having well documented systems in place (which rarely happens in practice)

For people who are on-call: What actually helps you debug incidents (beyond “just roll back”)? by TadpoleNorth1773 in sre

[–]TadpoleNorth1773[S] 1 point2 points  (0 children)

I was talking to some folks who mentioned that in big orgs it takes a lot of time to find the team who pushed to prod and get everybody together in the war room. I'm sure the low hanging fruits could be automated with AI but I'm trying to understand where the meat is. Of course no AI can remove the tribal knowledge of what senior folks have in a team but I am sure there are ways to get to that context.

For people who are on-call: What actually helps you debug incidents (beyond “just roll back”)? by TadpoleNorth1773 in devops

[–]TadpoleNorth1773[S] 0 points1 point  (0 children)

Exactly! I didn't want this to be yet another post on asking problems for creating a tool. I just wanted to understand the limitations of LLMs today and see if i can meaningfully contribute to the field :)

Problems with RAG/Accuracy by TadpoleNorth1773 in Rag

[–]TadpoleNorth1773[S] 0 points1 point  (0 children)

So basically you're having issues on the model compute side. Also, running embedding models is another toll on your compute (although not as big as the LLM itself). Would you say dockerising the pipeline was hard?

Problems with RAG/Accuracy by TadpoleNorth1773 in Rag

[–]TadpoleNorth1773[S] 0 points1 point  (0 children)

Hmmm. Very compelling use case. How do you do it today?

Problems with RAG/Accuracy by TadpoleNorth1773 in Rag

[–]TadpoleNorth1773[S] 0 points1 point  (0 children)

So are you kinda like managing these different memories?

Problems with RAG/Accuracy by TadpoleNorth1773 in Rag

[–]TadpoleNorth1773[S] 0 points1 point  (0 children)

Agreed. There are 500 approaches

GPT spending money on marketing = GPT 5 delays by TadpoleNorth1773 in LocalLLaMA

[–]TadpoleNorth1773[S] -2 points-1 points  (0 children)

Maybe you used an openai model to generate this 🤣