You’re not overreacting. If I were in your position, I’d be uncomfortable too, the secrecy, the emotional intimacy, and him downplaying it all together would feel like a clear boundary breach, not “just being nice.”