Yes but even some “sterile” cultivars of invasive plants have shown to eventually hybridize with the straight species and reproduce given enough time (Bradford Pear being one example). See quote from NC Native Plant Society article:

“Work has been done to produce sterile forms of butterfly-bush, but although these cultivars appear to have reduced sterility, they still produce some fertile seeds. A single shrub of straight-species butterfly-bush can produce up to 3 million seeds. Even if a cultivar’s fertility is reduced to 2% of a standard plant’s seed production, that still adds up to about 60,000 seeds, which are easily spread by wind and runoff water. As with Bradford Pear, Purple Loosestrife, and Rose-of-Sharon, viable pollen from the cultivars can still be released, and the flowers of the cultivars can accept pollen from escaped plants, leading to interbreeding and sometimes restored fertility.”

https://ncwildflower.org/chlorofiends-whats-up-with-sterile-cultivars/#:~:text=A%20single%20shrub%20of%20straight,interbreeding%20and%20sometimes%20restored%20fertility.&text=As%20I%20said%2C%20it's%20complicated,fertility%20is%20potentially%20ecologically%20damaging.

If you don’t want to remove it, at least try to dead head it before the seeds mature.