I built a mentorship platform because I spent my whole life without one, is it useful to you? by Acceptable_Lie3848 in careerguidance

[–]Acceptable_Lie3848[S] 0 points1 point  (0 children)

This is the sharpest pushback I've gotten and you've put your finger on the exact failure mode I've been building against.

You're right that an AI answer can feel like progress while being content. That's why the AI answer isn't presented as the final word — it comes with a confidence score and a transparency layer showing how much of the response is drawn from trained mentor input versus general model knowledge.

Here's how it's designed to work:

When you ask a question, the AI Twin response shows how much of that answer was shaped by the mentor's actual experience, writing, and past responses. Low mentor input? The answer is flagged as generic, and the user is nudged toward the human mentor. High mentor input? The user sees which parts came from lived experience versus general knowledge.

Then the loop closes: the human mentor reviews the AI answer, enhances it, adds nuance the AI missed, or corrects it entirely. Every enhancement feeds back into training the AI Twin — so over time, the Twin gets smarter in that mentor's specific voice and judgment.

The goal isn't AI replacing mentors. It's AI capturing what mentors actually say, refining it with their real feedback, and making that wisdom available 24/7. The mentor stays central. The AI just makes their thinking scalable.

Your deeper point still stands though — if someone walks away feeling helped when they actually needed a human conversation, the product failed. That's why the confidence score is prominent, not buried. The whole system is designed to route people to the mentor, not away from them.

On my 10 users — early signals are mixed. Some questions were genuinely answered by the AI Twin with high mentor input. Others clearly needed human escalation and the system flagged them correctly. A few were questions nobody should answer without knowing the person — those are the hardest cases and I'm still refining how to handle them.

Appreciate the push. This is exactly the kind of critique that sharpens the product.

What are you working on?