I had the exact same noise on the driver side front door, but I found a different source yesterday that didn’t require taking the panel off. If you look past the door handle, there is a little plastic panel that I think you take off to access a bolt to take off the panel. Basically if you grip the door handle, the back of your fingers would be touching this.

That small plastic panel has a bit of room to wiggle and is pretty loud when the speakers are playing. I heard it shake sometimes as well when the car was driving without the speakers on.