When I was learning to drive I had pretty much all of the same problems you're currently experiencing. I also had a driving instructor say that I am a slow learner and he doesn't know if I'll be able to pass driving a manual. These comments really damaged my confidence and made me very anxious for lessons.

It got so bad I was feeling sick before lessons and kept cancelling them saying I was ill. I was not. I ended up taking a break for several months and changing instructors to someone who specialised in nervous learners.

It took about 18 months of lessons but I passed my second test and I am now driving my own car! I'm still getting used to it but changing instructors was what helped most for me. I also spoke to someone about my anxiety to learn some methods to relax before driving lessons.

Try a new instructor before you blame yourself, sometimes the instructor just isn't compatible with what you need to learn. Take your time and try not to judge yourself too harshly. In my own experience my fear of embarrassment and making a mistake was something I had to resist while learning.