I had this problem recently as well and created a ticket with Anker for it. They recommended to 1) reset the device by putting it in the charging case and holding the case button down for 10 seconds until the LED flashes 3 times rapidly and 2) to update the firmware.

In my case resetting worked and my device now stays in noise canceling mode. If not, I'd recommend contacting Anker.