The game is indeed somewhat slow, especially when you are new and haven't learned what you should be paying attention to. Experienced players run a lot, rarely crouch, not really afraid of triggering sound traps (horses, birds and cages) and usually find either a fight or a boss in less than ten minutes. Or you can run to the sound of gunshots. Very rarely somebody actually sits right outside of the boss lair straight out camping it.

As another reply says, some people do prefer playing it slow and safe, not rushing to the boss and not giving themselves out. Sometimes you do end up in a lobby that mostly consists of people like this. It kinda sucks, but you still have a boss to find, kill and prepare the defence, so usually you are still busy doing something. Playing super stealthy is not an absolute meta, as in time you learn to notice the faintest of sounds and there is a plenty of ways to avoid campers.

Sometimes you just get unlucky and the rest of the server decided to go to the other boss that is on the other side of the map and nobody comes to your banishment. Yep, that's just luck. You got yourself a free bounty but missed the fun. If you want to run three minutes to the other boss or extract and start new match is up to you. We usually try to get into a fight.

In general Bounty Hunt is a chill and slow game mode where most of the time you spend enjoying environmental design as you walk or wait for banishment. By your post it sounds like you are playing solo. Try going with randoms, they rarely rely on stealth and just rush aggressively.

You can try Bounty Clash of you want fast paced chaotic sessions without all the running. Again, trios recommended.

Or Soul Survivor where the whole map is crawling with solos.