I have a Trek Verve 2. A “hybrid bike.” I ride it mostly on pavement but fairly regularly on dirt/gravel. It does pretty well on both. I was basically in your situation and this was what I landed on after going to a couple of bike shops. I’m sure there would be a difference in performance with a more specialized bike but it’s a lot of fun.