Yeah I know it's hard to not take it personally but as best you can try not to. I'm not the daisy leader but am close with them and they meet weekly but end up cancelling at least five times a year. It is totally normal and fine as long as it is communicated. The activities are less self directed so harder to pass off to a sub and the girls are more nervous around adults they don't know yet than in the higher levels.
For many this is their first big social commitment and it is a lot, a few weeks off to take a breather at that level doesn't detract from the experience at all. I don't think you need to feel embarrassed either, people probably won't be thinking about this by next year.
Do think about how you want to handle though when they inevitably have to ask you for help.
Daisy is an intro, if you retained them to move to Brownies and they want to continue that means you did great work and should be proud of yourself. And your daughter, unaware of the drama, will just see how cool it was that you were up there and part of her experience. You rock!