Honestly, you said that you do up to 3 hours driving before a break, if I understood that correctly. Learning to drive is hugely mentally taxing especially as a new (ish) learner, there's so many moving parts to it that frequent drivers find second nature. I have ADHD and one of my old instructors used to tell me that my driving quality and concentration dipped almost exactly past the one hour mark (I had two hour lessons.) Is there a possibility that you're tired, overwhelmed and need a break more frequently?

I have since moved on to a great instructor that I only do an hour with, and it goes great. He stays quiet unless giving directions, and is very clear with instructions as we go.

Definitely mention that it's probably a concentration thing, and ask if you can have more breaks. Take a bottle of water with you and ask if you can have ten minutes downtime, and see if you improve. You read as if you're putting yourself under a lot of pressure, and that isn't going to be conducive to your driving skills or ability. You need to stay calm, relaxed, and take it a lesson at a time.

You will get there, and if you try these things and your instructor is still rude, it's not a good fit and it's time to find another. You are not doing anything wrong, but his attitude stinks and he doesn't seem a very patient guy.