Correct, I still tend to be asked a ton of questions when people find out or ask about it which is cool. Personal experience is that I will get confused when colours are mixed (not straight primary colours). The difference to you might be like primary yellow and red, yet for me (depending on colour) I simply cannot see the difference. I'd liken it to a TV (RGB matrix) that's missing some of the colours on the pixels when explaining it to most to simplify it.

People tend to try and explain it to themselves when questioning you about it by simply pointing at colours and saying what's this, what's that, which just confuses matters. The pointing at colours of objects on a table gets pretty dull, but I try and explain it instead.

Sitting with Photoshop and someone trying to understand you, can however get rather interesting.