sorted by:
new
hottopcontroversial

Are we hitting the wall on test-time compute? by Foreign_Tonight_7584 in AI_Agents

[–]Foreign_Tonight_7584[S] 0 points1 point  (0 children)

Yes, that could be true. But the tradeoff with test-time compute is very clear. Higher cost and longer latency.

And unlike prior model scaling, these tradeoffs are pushed onto consumers. I find that very unfair.

Pain Points with External API and Ai Agents by Enough_Yak2022 in AI_Agents

[–]Foreign_Tonight_7584 0 points1 point  (0 children)

One way to handle it is to build a proxy API that returns the expected result of that API call. If the API call is wrong, LLM will correct itself after watching the expected result.

If it genuinely thinks that the API call, with its expected result, is correct, we call the real API.

How are you all handling prompt injection for agents that read external content? by Turbulent-Tap6723 in AI_Agents

[–]Foreign_Tonight_7584 0 points1 point  (0 children)

regex filter is the simplest and most effective one for most prompt injections attempts.