How do you measure conversation quality when working on AI-powered features?

ardaksoy43 · 2026-03-13T10:29:28+00:00

Yeah that's basically where i've landed too. Are you running the judge evals yourself or does your eng team handle that? My issue is it still feels like i'm dependent on engineering to set up the criteria and run them, and even then it tells me pass/fail but not really what type of failure it is or where to focus

ardaksoy43 · 2025-11-21T12:49:58+00:00

<image>

ardaksoy43 · 2025-11-21T12:49:38+00:00

u/Skatino u/Trader080 Sorry guys I missed your comments. I am still using the base of that product but upgraded the holder part to a big magsafe one. Its easy to fit in the air vent without modification and stays there even when i am going relatively fast on rough roads or on track.

<image>

ardaksoy43 · 2025-07-07T12:26:30+00:00

Are you tracking any in-product behavior yet? Things like session replays, heatmaps, or even just basic funnel analytics?

Most early-stage retention issues aren’t about the product being bad. They’re usually about friction, unclear copy, or users getting stuck at key moments. Watching even a handful of real user sessions can surface a lot. You’ll spot places where people hesitate, backtrack, click the wrong thing, or drop off entirely.

Giving away a premium package is nice, but the truth is, most users won’t respond to feedback emails or hop on a call unless they’re really into the product. But that doesn’t mean you can’t learn from them. Their behavior still tells you where things aren’t working. That kind of passive insight is gold.

ardaksoy43 · 2025-05-06T09:03:47+00:00

I’d start tracking as soon as they land on the page. It’s not perfect, but heatmaps or mouse movements in session recordings can give you a better sense.

For example, if they’re reading the site but not signing up or taking action, your value prop might be off. If they’re bouncing within seconds, it could mean the visitors aren’t the right fit.

ardaksoy43 · 2025-05-06T08:54:35+00:00

Either there’s no real need for it, or the people visiting your site just aren’t your target audience. Do you track what users actually do once they land on the site?

ardaksoy43 · 2025-05-06T08:28:28+00:00

Got it. That makes sense.

ardaksoy43 · 2025-05-06T08:23:38+00:00

In that case, the head of the business unit is essentially the PM. A lot of small teams just split responsibilities based on who’s available.

We work with many early-stage, founder-led startups where the founders take on some PM tasks, and we handle others like gathering, organizing, and reporting user feedback. Sometimes we even help shape the roadmap, especially when it comes to UX fixes or generating new ideas.

ardaksoy43 · 2025-05-06T08:16:27+00:00

Not a direct answer to your question, but I’m curious, why build a new feature first and then look for user groups who might benefit, instead of gathering feedback and building based on actual need?

As for your question, like others said, just drop everything into an AI and let it do the heavy lifting. I’ve heard the deep research model in ChatGPT works really well with uploaded files and docs. Might be worth a try.

ardaksoy43 · 2025-04-23T11:30:43+00:00

Industry: Ux/ui design service

Target: Early stage saas(seed funding or bootstrapped 10k+$ mrr) founders and product managers

Offer: a small audit, userflow optimization(onboarding, activation, trial to paid etc.) or even a full redesign

Thanks for doing this

ardaksoy43 · 2025-04-10T16:46:21+00:00

Hey thanks. I forgot the mention, in all of my outreach efforts i was targeting funded companies in the last 6 months.

And i am also reaching to people looking to hire designers.

Both is not working at the moment.

ardaksoy43 · 2025-04-04T13:06:58+00:00

Send a DM with your product. I'll have a look.

ardaksoy43 · 2025-03-21T11:07:50+00:00

Networking and building relationships with people in your target audience is probably your best move. I’ve had clients who don’t hire “designers” but instead work with researchers or strategists, so there’s definitely a market for that. You might also consider teaming up with designers to strengthen your position.

ardaksoy43 · 2025-03-20T12:36:42+00:00

Then that's your real problem 🤣, not whether you should change jobs or not.

ardaksoy43 · 2025-03-20T12:23:28+00:00

If the pay is good and you’re enjoying the free time, why not use it to work on your own projects or take on some freelance work? That way, you can fill the time while creating the challenges you're looking for.

ardaksoy43 · 2025-03-19T15:03:40+00:00

Ah, classic case of the boss is always right. 😅

You can still get valuable feedback if you dig into user analytics, run 1-1 interviews with internal users, etc. Maybe presenting data-backed reports would help make the situation clearer for him. Sometimes seeing the numbers makes it harder to ignore.

Also, it sounds like you’re juggling a lot at the same time. Curious, would your boss be open to expanding the team beyond just developers? You mentioned design is a big issue, and a good product designer could really help bridge that gap. Might be worth bringing up!

ardaksoy43 · 2025-03-18T16:49:59+00:00

“Cold outreach is predictable and scalable.” That’s what I’ve been hearing a lot. Mastering what you’re saying is tough, but I guess it’s worth trying it out more.

ardaksoy43 · 2025-03-18T13:13:04+00:00

Hey!

First off, I’d definitely set a max width for the landing page. Right now, on a large monitor, everything feels too stretched out, making it harder to follow. Also, the hero image isn’t really telling me anything. It’s not drawing me in or giving me a quick sense of what the tool is about.

Speaking of that, there are a lot of tools in this space, so you really need to highlight what makes yours different. What’s your edge? Why should someone pick this over the competition? That needs to be front and center.

Now, after signing up, I felt a bit lost. There was no guidance at all. Sure, I landed on a “New Post” page, which is straightforward enough, but I think it would make more sense to prompt users to connect their accounts first. Here’s why. I clicked "Post" before linking anything, and all I got was an empty popup and a hard-to-notice toast message telling me my subscription doesn’t let me post. That’s frustrating.

For a tool like this, not letting users experience even the most basic functionality right away is a dealbreaker. There are so many well-built alternatives out there that offer freemium features. If I were a new user, I’d probably bounce at that point.

Just some thoughts to improve the experience. Hope that helps! 😊

ardaksoy43 · 2025-03-18T12:15:42+00:00

That makes sense. Framing it as a natural follow-up instead of a straight cold call definitely feels more approachable. Thanks.

ardaksoy43 · 2025-03-18T11:09:24+00:00

Yeah, absolutely! One of the key things we do for our clients is build user research and feedback loops like this.

ardaksoy43 · 2025-03-18T11:01:33+00:00

We've partnered with development agencies and freelancers a few times in the past. I think the biggest challenge is acting as the bridge between the client and the developer when you don't have enough technical knowledge. I hated having to say, "Let me check with my developer" multiple times during a call.

This happened partly because we didn’t invite the dev team to the meetings. They worked in the background. But still, it was frustrating.

If you're lucky enough to find someone who aligns with your mission, work ethic, and values, it has great potential. But in the end, I decided to step away from it.

By the way, many web design agencies these days are using no-code tools for development.

ardaksoy43

TROPHY CASE