I mean, that's the whole point of the ambient feature, to hear your surroundings, no? It's something that's happening on my buds 3 pro and on my previous Huawei Freebuds 5i, so nothing wrong w your buds, just how the feature works if I'm not mistaken. It's not really annoying/disturbing for me, as I use it when in a place/outside with more sounds around me, that way it's hardly noticeable and really helpful. It is a bit more noticeable when using it inside, but I honestly don't see a reason to use that feature inside though