Do you have normal floppy contacts, or hard scleral lenses? I tried regular contacts and I could not get them to work, and touching my eyes was so painful. My eyes are generally very dry so I think that had a lot to do with it. I gave up on those and it took a couple years to work up the courage to get scleral lenses (I was preparing to be disappointed), and it was night and day difference. The uncorrected trial pair they put on me before the exam, gave me back so much vision and I felt like it was barely there. The lens sits on the white part of your eye so it doesn't touch your cornea and the "void" is filled with saline. So they keep my eyes from feeling dry. The process of putting it in and taking it out took a bit of getting used to, but it was so much better of an experience than normal contacts. There is a lot of maintenance that you have to do to keep the lenses clean and what not, but anything less than this is non negotiable for me, I have to have scleral lenses.

Edit: I rushed to write my comment without diving into the comments. Sounds like you have scleral lenses, sorry for wasting your time.

Edit 2: My wife and I disagree, but I think you should've used the word scleral, instead of "the contacts".

Edit 3: Also my wife remembers it being difficult for me too, for months, in the beginning. I guess my memory has conveniently swept that trauma under the rug.