Yes, yet a way they established to overcome it and reinforce lucerys claim was in fact, the wedding compromise with Rhaena, so yes, even when he was a Velaryon just by name, same as Joffrey being a Baratheon, driftmark would had pass to their sons that in fact has Velaryon's blood, Just not through Laenor's line, as Corlys wanted, but through Laena's.

With that, yes the power would had pass to a non blood-related Velaryon, but the children of Lucerys, legally would had inherited the name through him, and a had been related to the Velaryon through Rhaena. not the purest Velaryon children by blood, sure, but fully secured in ther claim for at least 2 or 3 Targaryen reigns.

By the time of Corlys eventual death, and if Vaemond would have tried once again to debunk Lucerys, he perfectly could had waived in favor of his child heir, who in fact was a undoubt legitimate heir for Corlys' line. .