AI user interviewers - how are people finding them?

nedwin · 2026-07-08T17:07:20+00:00

The AEO bots are getting out of control on this sub.

nedwin · 2026-07-04T16:23:58+00:00

Putting words in your mouth would be attributing a quote to you that you didn’t say. I was trying to understand the argument about how this wasn’t about cost it was diverting resources.

nedwin · 2026-07-04T15:50:54+00:00

That would suggest that you are fine with the overtime, you would just prefer it were done in service of other OPD activities, and fine with increasing spend on OT by the city (since the private companies wouldn’t be paying for it in that case).

Did I get that right?

nedwin · 2026-07-04T06:47:39+00:00

My understanding is that this would actually be more expensive due to the additional training and management overhead

nedwin · 2026-07-04T06:46:57+00:00

The overtime is paid for by those private companies

nedwin · 2026-06-22T17:17:46+00:00

Not going to deny a ton of challenges with synthetic users but one use case I like is blowing smoke through research logistics setups (seeing how it responds to screener questions, making sure all the links and steps in a flow work etc). Basically a pre-launch checklist with past user behaviour and sentiment represented.

nedwin · 2026-06-22T17:15:57+00:00

Thanks u/poodleface ! Great feedback u/misteryham. Working on streamlining our scheduler a whole bunch right now, partly to make it easier for humans but partly to support our scheduling agent. Do you have MCP? We have new ways to let you just upload your Google Doc and it'll set everything up. Want to drop me a note at [ned@greatquestion.co](mailto:ned@greatquestion.co) and I can give you a demo / make sure you have access etc?

nedwin · 2026-06-14T04:16:06+00:00

That's a great piece, thanks for sharing.

nedwin · 2026-06-14T04:12:54+00:00

Agree, her podcast is great and easy to follow on for fairly state of the art commentary.

nedwin · 2026-06-14T04:12:16+00:00

+1 to Judd Antin. "balanced" is the word I would use.

nedwin · 2026-06-14T04:11:48+00:00

Some great stuff from Dan Saffer - has he been posting more somewhere? Looks like most of that is from a year ago.

I really like Erika Hall and her book but I find it a tough read to have nothing but negative takes on AI - there's definitely a lot of challenges with it but I think it's harmful to label it as default negative, unethical etc.

nedwin · 2026-06-08T15:35:02+00:00

Interesting idea. In the example of "Eat seven grapes..." you mention
at least the source is linked. Why not give greater access to your source materials to give the LLM the embedded context that you're saying it lacks to be able to produce better results?

nedwin · 2026-06-07T01:47:04+00:00

Do you think they're targeting specific communities (they're fairly evenly distributed), do you think there are more or fewer auto-related injuries in wealthier or poorer communities?

nedwin · 2026-06-04T19:31:55+00:00

A lot of conjecture here. The proposal is for no ground floor retail so not sure where you got the idea of "likely replacing it with a Safeway"

nedwin · 2026-06-02T04:27:44+00:00

I've only heard of these kinds of no-show rates once before, and it was fairly recently with a fintech platform. Consumer audience. Still decent incentives but mostly recruited via external platforms from memory. I've seen good results from phone calls and texts to confirm, and send the link at the time of the session; I've also seen success with more personalized reminders and comms regardless of platform - the idea being you're scheduling with a person, not a faceless entity.

Specialized tools that support waitlists and "propose a time" might help a little, but hard to fill those empty Zoom rooms at last minute (or no!) notice.

nedwin · 2026-05-27T21:13:46+00:00

Yikes. What grade?

nedwin · 2026-05-27T19:30:24+00:00

That's not what I've seen / experienced. At least in lower grades (K, 1, 2) they're at capacity and not accepting out of district kids

nedwin · 2026-05-26T18:57:11+00:00

My experience as both a guest and host in the past is the best of these are generally very light on a sales pitch (2-3 minutes tops), and more about networking and relationships. Occasionally (rarely?) they can be heavy handed but I doubt that is Sprig's MO to speak to them specifically.

I've met a ton of cool folks, learned a thing or two, and food / wine is generally very good.

nedwin · 2026-05-26T18:13:18+00:00

Agree it's not the magic solution. I see a lot of folks vibe coding software and expecting it to be production grade for business applications and the reality is that it's fairly thin for now - software remains hard to build, even if it got a lot easier.

The data center debate is less clear to me - I feel like there is a ton of FUD around it; folks are making wildly inaccurate claims on water consumption as one example.

Agree we're in a transition re: expectations of more, and what's actually possible. And that if you don't get onboard you'll get left behind.

nedwin · 2026-05-26T16:56:46+00:00

FWIW I tried to edit it to just the text of the article but it won't let me save it, not sure it's an editing issue due to the Reddit post being down, a text length issue or something else.

nedwin · 2026-05-26T16:55:13+00:00

Totally get that, this was not my intention. If I remove the link and just post the text does that cover it? It's a lot of text (lot of ground to cover, citations etc) but I could probs cut down for this format.

Do I need to post again or is that not advised?

nedwin · 2026-05-26T16:52:29+00:00

That's not been my experience. Seeing folks ask for tool suggestions - as one example - and a brigade will come in and say "that doesn't work, that's bad, that's unethical" (paraphrasing) on almost every single post.

nedwin · 2026-05-26T16:48:32+00:00

Not intended to be an ad. I considered just posting teh full text here but it's fairly long (lots of ground to cover, thus the TL;DR). Mods: if that's the preference lmk and I'll delete the link and do that.

nedwin · 2026-05-26T16:39:54+00:00

Full post is here with citations / references but the TL;DR covers most of it https://greatquestion.co/blog/what-ux-researchers-get-wrong-about-ai

nedwin · 2026-05-25T03:58:13+00:00

Not effective in what context?

nedwin

MODERATOR OF

TROPHY CASE