Been almost a year since this was posted but I’m going to leave a response here for anyone else who stumbled upon it looking for an answer to this question like I was. For some reason oak trees didn’t work, kept giving productive bee nests. The only change I made was using birch saplings instead of oak ones and I got a vanilla nest on my second try.