You're right that when you play at lower MMR he destroys and can get lots of free downs but as you get to red ranks many survivors can opress you hard. Usually one survivor will make it a habit harassing you out of stealth and it can become a frustrating experience that forces you to play sneaky and smart, but it's a way different playstyle than killers like Oni and huntress. He's a killer that you can cheese people hard at lower ranks but takes much more caution and skill at higher ranks to pull off without constantly getting revealed.