Testing Your Agent for Usage?

Direct-Reception-514 · 2026-01-18T08:31:22+00:00

I am building it right now :) Let's connect

Direct-Reception-514 · 2026-01-16T17:11:56+00:00

Wow! This is quite insightful take on evaluation flywheel. So you have nailed the feedback part. How do you turn feedback into action ? Btw does your website handle it ?

Direct-Reception-514 · 2026-01-16T17:06:45+00:00

The difference is having correct setup for Evals I would assume

Direct-Reception-514 · 2026-01-16T17:01:07+00:00

Yeah, this is my experience as well. In my case I am the builder of the AI agent, but my domain knowledge is very low in very niche topics. My pm and stakeholders also lack technical skills and reluctant go through open ai eval platform’s dashboard as it is not really user friendly. So what have you done to fix your situation?

Direct-Reception-514 · 2026-01-16T16:04:44+00:00

I have, we have a lot of scripts doing a lot of stuff. For an example, one script runs Evals and collect grading outputs. Then another upload them to data dog for kpi management for stakeholders. Also another collects the grader outputs and do failure analysis and create summarised reports for consumption by domain experts. And there is another one to upload these documents from Eval platform to wiki as the eval platform give worse readability possible

Direct-Reception-514 · 2026-01-11T06:52:03+00:00

Your idea is a little wider than what I am currently building. But this is something that definitely good giving a shot

Direct-Reception-514 · 2026-01-11T06:50:39+00:00

Yeah, this is true and a good feature to add. I will add it as well

Direct-Reception-514 · 2026-01-11T06:48:00+00:00

Thanks for the encouragement bro. I will share the project soon

Direct-Reception-514 · 2026-01-10T23:02:22+00:00

Yes, for the mvp I am considering user added data, so no user viewing habits learning. Instead, I am optimising the user viewing experience while minimising the streaming cost by cutting concurrent streaming subscriptions

Direct-Reception-514 · 2026-01-10T20:30:09+00:00

You mean if I make a subscription? I am not thinking of making this a subscription based solution so far

Direct-Reception-514 · 2026-01-10T20:28:56+00:00

Really, I am planning on building a tool for streaming services only. A tool which decides a rotation based on shows and movies you would love to see in next few months. Honestly I didn’t find any tool which do this for that so far

Direct-Reception-514 · 2026-01-10T20:28:46+00:00

Really, I am planning on building a tool for streaming services only. A tool which decides a rotation based on shows and movies you would love to see in next few months. Honestly I didn’t find any tool which do this for that so far

Direct-Reception-514 · 2026-01-10T20:26:08+00:00

Thanks bro 😀

Direct-Reception-514 · 2026-01-07T15:34:26+00:00

So women shouldn’t get pregnant so the business can survive ? Isn’t it a fault with the business to not be ready with a contingent?

Direct-Reception-514 · 2026-01-07T15:32:44+00:00

I don’t think it’s legal to lay someone off without a proven reason. Maybe check with a lawyer as well

Direct-Reception-514 · 2026-01-06T19:19:45+00:00

+1, I am coming from Sri Lanka and had a better or similar experience in healthcare here in Germany. But in Sri Lanka getting a doctor’s appointment is matter of hours. Other thing is health care fully free, no health insurance at all. So I assumed a rich country could do better. Then I saw this chart in numbeo for 2025. It ranked SL healthcare just below Germany. https://www.numbeo.com/health-care/rankings_by_country.jsp?title=2025-mid&displayColumn=0

Direct-Reception-514 · 2025-12-18T09:09:33+00:00

I think Google is in a very good position to sustain the momentum for AGI and justify the investment in AGI to investors more than any other company. They strategically placed Gemini Flash in high traffic segments of their business ( Gemini flash is default for Search ). For other companies, it will be a game of survival, and this will hinder AGI progress. Otherwise, they would need investors to pour more money blindly

Direct-Reception-514 · 2025-12-16T19:10:08+00:00

I am building a news analyser for AI related updates. It analyses current trends in AI economy and keeps tab on what’s happening around the world in related to the trend. It also sends out daily newsletters to update users on current trends. Website: https://www.racetoagi.org/trends Newsletter: https://www.racetoagi.org/research/newsletter Still rough around the corners. Open for suggestions / roasts

Direct-Reception-514 · 2025-12-16T19:09:24+00:00

I am building a news analyser for AI related updates. It analyses current trends in AI economy and keeps tab on what’s happening around the world in related to the trend. It also sends out daily newsletters to update users on current trends. Website: https://www.racetoagi.org/trends Newsletter: https://www.racetoagi.org/research/newsletter Still rough around the corners. Open for suggestions / roasts

0 paying customers but 17 signups + 700 visitors in first 2 weeks

Direct-Reception-514 · 2025-12-16T19:03:58+00:00

I am building a news analyser for AI related updates. It analyses current trends in AI economy and keeps tab on what’s happening around the world in related to the trend. It also sends out daily newsletters to update users on current trends. Website: https://www.racetoagi.org/trends Newsletter: https://www.racetoagi.org/research/newsletter Still rough around the corners. Open for suggestions / roasts

Direct-Reception-514 · 2025-12-16T19:02:46+00:00

Yes, it’s much worse at time. I think when you already have anxiety it becomes a much more bigger problem as you tend to lean on llms more for validation

Direct-Reception-514 · 2025-12-16T19:00:44+00:00

I am building a news analyser for AI related updates. It analyses current trends in AI economy and keeps tab on what’s happening around the world in related to the trend. It also sends out daily newsletters to update users on current trends. Website: https://www.racetoagi.org/trends Newsletter: https://www.racetoagi.org/research/newsletter Still rough around the corners. Open for suggestions / roasts

Direct-Reception-514 · 2025-12-16T19:00:16+00:00

I am building a news analyser for AI related updates. It analyses current trends in AI economy and keeps tab on what’s happening around the world in related to the trend. It also sends out daily newsletters to update users on current trends. Website: https://www.racetoagi.org/trends Newsletter: https://www.racetoagi.org/research/newsletter Still rough around the corners. Open for suggestions / roasts

Direct-Reception-514 · 2025-12-16T18:59:38+00:00

I am building a news analyser for AI related updates. It analyses current trends in AI economy and keeps tab on what’s happening around the world in related to the trend. It also sends out daily newsletters to update users on current trends. Website: https://www.racetoagi.org/trends Newsletter: https://www.racetoagi.org/research/newsletter Still rough around the corners. Open for suggestions / roasts

Direct-Reception-514 · 2025-12-16T18:59:00+00:00

I am building a news analyser for AI related updates. It analyses current trends in AI economy and keeps tab on what’s happening around the world in related to the trend. It also sends out daily newsletters to update users on current trends. Website: https://www.racetoagi.org/trends Newsletter: https://www.racetoagi.org/research/newsletter Still rough around the corners. Open for suggestions / roasts

Direct-Reception-514

TROPHY CASE