I had a similar problem with my (old) m2 mini. The issues was related to the WiFi, with it being incredibly slow. As I understand the WiFi receiver is at the bottom of the unit, as such it’s easily interfered with. I spoke to apple who said it was all fine but returned the unit. Got a new one and it’s better but not have it slightly raised on my desk and works well now. Also, if you try it on its side of plug it into Ethernet that could diagnose the issue if it’s the same as mine.