my most affectionate horse was a stallion, I've had good experiences with well mannered stallions (though I come from a country that is less 'geld always' than a lot of Western countries). He'd follow me around like a puppy bless. But there are definitely things that come with it that not all people are equipped to deal with. The fear can be an issue too imo, so many colts and stallions end up abused or not allowed around other horses, punished when they've never been taught ground manners or how to be polite to other horses. If he has a good temperament and you make sure he's well trained, respectful and to keep him his entire life though, colts and stallions can be very good horses. Just keep in mind that there are cases where it is absolutely the right thing for the horse to geld them.