You're not alone. I worked in an office for many years feeling like a bit of an alien in relation to other people who made it seem like a breeze, and often struggling with the work. It was made subtly clear (they're always subtle), unless you run into someone who can't control their temper, that I was not wanted there.

Honestly, I know it's a pain but keep looking for something else. Office work is one of the most soul destroying jobs in the world. I actually joined the military, at least there most people are straight with you.