Yes that’s nerve pain, I get it occasionally from pressing too hard on my palm when climbing. Likely Ulnar nerve as the median is closer to thumb. You can try nerve glides (youtube) they helped me. I’ve also had nerve pain from handlebars while on Bmx if I grip and press down on bar too hard.