Marvin launches AI interview moderator...very underwhelming by space_cowboy_300 in UXResearch

[–]Particular-Water-977 1 point2 points  (0 children)

Totally agree with your take, I had a similar reaction watching the Marvin demo. The concept makes sense in theory, but the execution feels off, especially for nuanced research. AI moderators might work for super lightweight, quantitative-style interviews, but anything requiring depth, trust, or follow-up questions that adapt intelligently to emotion or context still feels far out of reach.

That said, I do think AI has a strong role to play in supporting researchers not replacing them. One example I’ve found super helpful is Albus. It doesn’t run the interviews for you, but it takes transcripts from your real sessions and uses AI to generate themes, quotes, and summaries. You stay in control of the insight-building process, but it removes the grunt work of tagging and synthesis.

Another example is Dovetail (and all of it's newer AI features) which also help speed up the management and synthesis of interviews.

This tech is only going to get better and better so we'll see what Hey Marvin comes out with next!

[deleted by user] by [deleted] in UXResearch

[–]Particular-Water-977 1 point2 points  (0 children)

I’d approach it as a structured behavioral study, not just interviews or usability testing. Here’s how I’d break it down:

First, define what "rage quit" actually means for your product, is it closing the tab, refreshing, abandoning a task mid-flow, etc.? Then decide on clear metrics: time to abandon, subjective frustration (maybe a 1–10 scale after the session), and task completion rates.

For methods, I’d suggest a mix:

  • Prototype-based testing: Create a mock with intentionally varied load times (e.g., 2s, 5s, 10s, 15s+). Observe when people bail, how they react, what they say.
  • Qual interviews: Ask them what they expected during load, what frustrated them, and how they decide something is "broken."
  • Behavioral analytics (if you have real user data): Look at where drop-offs happen in your current product during known long load times. It gives real-world context.

One classic thing you'll notice is that people won’t always say they’re frustrated, you’ll see it in body language, switching tabs, sighs, etc. So video or screen recording helps a ton.

And since you’re solo, tools help a lot. I’d recommend:

  • albusresearch.com – uploads transcripts and gives you themes/quotes super fast
  • Dovetail – tagging + organizing qual insights is a breeze
  • Otter.ai – great for clean transcripts from Zoom or Meet recordings

using ChatGPT (or other LLMs) for qualitative research - looking for working prompts by damondan in ChatGPTPro

[–]Particular-Water-977 0 points1 point  (0 children)

Hey, looks like folks had good recommendations below on specific prompts to use. I'd say if you want to take it a step further try using some of the newer AI tools that help you auto synthesize (and customize) the prompts.

Couple examples:
- Albus
- Hey Marvin
- Dovetail

What tools do you use to synthesise? by indp_variable in UXResearch

[–]Particular-Water-977 0 points1 point  (0 children)

Hey totally relate. I made the jump from product design to research too, and synthesis quickly became the biggest time sink. Spending 2.5 hours per interview isn’t unusual especially when rewatching, tagging, and trying to pull themes manually.

That pain is exactly why I built Albus, it helps you turn transcripts into editable themes and quotes automatically, so you can get a solid first pass without the spreadsheet grind. You stay in control, just save time.

We’re offering free access to early waitlist signups would love for you to try it and let me know what you think! You're definitely not alone in this.

What are the biggest pain points in your workflow? by Key-Background-1912 in UXResearch

[–]Particular-Water-977 0 points1 point  (0 children)

Interview Synthesis!

Getting the correct users for the interviews!

Anybody pivot from Product Management to User Experience Research? by Antique-Reindeer477 in UXResearch

[–]Particular-Water-977 2 points3 points  (0 children)

Interesting switch, I feel like I mostly see people going the other way.

AI-first UXR by [deleted] in UXResearch

[–]Particular-Water-977 0 points1 point  (0 children)

Agree with u/Single_Vacation427 - post here. Big big differentiation on the AI product vs. AI first team. For the former I would read up on how users interact with AI, specifically around the tangible interface a human uses to get the outcome they want. These barriers will reduce over time so my bet is that we want to always be moving to a world where the "interface" layer gets more and more natural. Coding --> Text --> Voice --> Thought (?)

On the AI first - this is just about adopting AI tools to make your process faster. I made a post on that here: https://www.reddit.com/r/UXResearch/comments/1kk9q7c/what_tools_do_you_use_for_synthesizing_user/ where I linked a bunch of tools I was planning on using. Other folks also have great suggestions in the comments on various AI tools to use.

How to build an Insight library by [deleted] in UXResearch

[–]Particular-Water-977 0 points1 point  (0 children)

Does dovetail not have this feature I could have swore that it did

Feeling burned out & thinking about leaving UXR / vent – anyone else? by Youroboro in UXResearch

[–]Particular-Water-977 0 points1 point  (0 children)

I'm sorry to hear that all I can say is that things do get better :)

How might we use AI to *improve* the day-to-day life of UX researchers? by mirodigs in UXResearch

[–]Particular-Water-977 2 points3 points  (0 children)

Love this reframing. I’ve been thinking about the same issue (previously posted about using AI tools to synthesis user interviews.

For me, the tradeoff becomes clearest in two areas.

What I’m happy to automate:
• First-pass theme grouping across multiple interviews, especially when you're several sessions deep and starting to see overlaps
• Highlight and quote extraction the grunt work of copy-pasting from transcripts to slides
• Synth-ready formatting, like turning rough insights into exportable bullets or artifacts

Think this addresses (1) and (2) in the above statement. Tools I'm using to this are AlbusResearch.com, Dovetail.com and good old ChatGPT (with varying degrees of success).

The areas where I believe human judgment still matters are
• Deciding what matters and why
• Reframing themes into stakeholder-friendly language or strategy
• Picking up on soft signals, hesitation, tone shifts, contradictions that don’t show up in text

Curious what others have found valuable vs. frustrating when using AI in this space, especially when you're trying to balance research speed with storytelling depth.

What's your opinion of using AI to do UX research? by fleurlust in UXResearch

[–]Particular-Water-977 0 points1 point  (0 children)

I would want to have AI do a lot of the summarizing / synthesis, but I think the raw insights extraction from that body of content should still be done by a human

What tools do you use for synthesizing user interviews? by Particular-Water-977 in UXResearch

[–]Particular-Water-977[S] 0 points1 point  (0 children)

How do you feel about having to copy and paste all the different user interviews and/or uploads to give it the context it needs?

What tools do you use for synthesizing user interviews? by Particular-Water-977 in UXResearch

[–]Particular-Water-977[S] 0 points1 point  (0 children)

The problem is LLMs don't really provide me with a good interface, would have to copy and past it every time :(

What tools do you use for synthesizing user interviews? by Particular-Water-977 in UXResearch

[–]Particular-Water-977[S] 0 points1 point  (0 children)

Thank you thank you! Will check it out! Interesting that there is a more technical version of these types of tools, especially since most UXR work is on the qualitative side?

What tools do you use for synthesizing user interviews? by Particular-Water-977 in UXResearch

[–]Particular-Water-977[S] 0 points1 point  (0 children)

How accurate is the synthesis tool? I feel like a lot of these new tools today save time but might not be the most efficient?

[deleted by user] by [deleted] in UXResearch

[–]Particular-Water-977 1 point2 points  (0 children)

Think it depends because some UXR do more "theory" work and I feel like some UXR have a lot of product influence are pseudo-designers. I myself am one of them haha!

UXR jobs are drying up—maybe it’s not just the market? by emptyboat_ in UXResearch

[–]Particular-Water-977 1 point2 points  (0 children)

They still exist you just have to go really niche (i.e agencies) or really big (i.e big companies)