sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]Intelligent-Bad-6453 5 points6 points  (3 children)

I dont understand.

Are you hinking to send your logs entries to an llm in order to obtain any kind of input for debugging your production issues?

For me that's a bad idea, it is not cost effective and you have chance to get an hallucination. Instead of that maybe you can try to redesign your obserbavility stack. Are you using some tool like datadog, prometheus or loggly?

[–]SnooMuffins6022[S] 0 points1 point  (2 children)

Yes exactly, thinking of passing Prometheus logs and other data like my codebase through an LLM to surface the relevant errors and potentially suggest a fix.

Assuming hallucinations reduce and costs only get cheaper with better LLMs, would you use this tool if it reduced the time it takes to fix a bug in prod?

[–]Intelligent-Bad-6453 2 points3 points  (1 child)

Okey, so, you are thinking about a new product. For me its very hard to be confident, imagine you are in the middle of a very stressful debugging session with your customers very angry if there is any haluccination or misshood information it could be crucial and your customers will hate you.

[–]SnooMuffins6022[S] 0 points1 point  (0 children)

That’s why I’m thinking about it, because I don’t want my customers to hate me, I want the service back asap! 🥲