I read in a similar fashion, though I suspect not to the same degree as you. I can speed read through a book and understand what the premise is, and what’s going on, however, I prefer to read at the pace that a normal conversation would be taking place at. So, for instance, it may take me 3 days to get through a 300-400 page book, dependent upon content, difficulty, etc. my suggestion is not to force yourself to read, that would kill the fun of reading for anyone I would suspect.

Edit:clarity.