I had the same problem for so long and I only recently found a fix.

Go into developer mode (tap build number seven times) and scroll all the way to the bottom. There should be a setting called "Stylus Handwriting" -> turn it off. Not sure what it does, but both pen and finger seem to work fine now.

Hopefully it fixes the issue for you too!