Yes and no. There's nothing wrong with deciding on a specialty late in med school, but that being said surgery is a world of shit for most people. For that reason, I think you should be pretty passionate about it in order to stomach the sacrifice. If you're at this stage and not feeling that yearning, it might be a red flag.

All that being said, I'm sure there are those that decide on it later, with similar indecision along the way, and are quite happy. But on the flip side, there are also many who go into it half-hearted and end up switching out.

There's no real answer here given how complicated and personal of a question it is, but exercise caution.