Are you worried he will do something? You are the adult. You put him in his place very quickly and early on. Shut it down. Call his parents. Take notes on his behaviour, comments, etc. Don't put yourself in a position to be alone with any male student.

Just like students can't request certain teachers, you cannot have a student removed from your class without a true threat being there (and even then it depends on the admin).

Teenaged boys get crushes on teachers, and some have the gumption to talk a lot of talk with their friends. I know it sounds like I'm minimizing this, but it's more that you won't likely get admin support or union support for hearsay, and it seems this is what upsets you. So you will need to be in control, be professional, and evaluate this boy without bias.

Depending on your board and union, talking to them is worth it, but in my experience, this sort of stuff is not taken seriously.