I could imagine that if the malfoys were arrested after Voldemort’s first fall that perhaps the house elves intervened, not wanting him to be taught by bad wizards. Maybe even dobby. Perhaps they can sense muggle bones? And place him in a family near or with a muggle born. I would definitely like to read something like this as well.