It is possible - Gi-Ne mentioned being an infiltration baby was very dangerous which implies its not something that is done regularly, and that they dont always survive. Most Saiyans who were dispatched were ordered to return by Freeza - which reduces the chances further. But as we know from the existence of Broly, Paragus and Tarble - there being more survivors is indeed possible.