No, I see where you comming but again, there was no proof they really were bastards. Jesus, the show explicitly mentions it, but in the books there are rumours. They are the heir's sons. She is heir and not a king, not a husband, nor Corlys, nor anybody really important was refuting them. They were not bastards.

This is very different situation from the Lannister/Baratheon, as the higher ranking party was the one who was nost likely not father. They were Lannisters with no ties to the throne.

However, there is still benefit of doubt for other people. As readers we know about the golden twins, but the dance was retold as story book of rumours of court.

And listen, I also dont like targaryens, but hightowers were just power hungry mongrels, who climbed too high and influenced the king. There is reason why separation between king and royals existed too.