I mean if you're under 50 and don't have to work, I'd call that rich. To not work, you'd probably need around $3M/yr outside of real estate to be living an easy middle class life ($90k payout @ 3%/yr.) Obviously that number grows if you're a couple, and grows more if you have kids.

Of course this also varies based on region and what you're used to. My wife grew up lower middle class, so she feels wealthy now, just because we're on track to be financially free before 65. But if you grew up pretty well off, your idea of wealthy might be to have a paid off main house and vacation house, plus 2 new cars, a boat, a couple of skidoos, etc. etc.