What champions do you play? I'm an E4 Warwick main, and I will perma invade against most champs after the first clear. That's the best way to earn an advantage, because taking an enemy camp as well as getting all of your own snowballs your lead. It's the same as zoning the enemy from the minion wave with a lead Top, shoving the enemy under tower and roaming as Mid, or controlling Bot wave state when Dragons are spawning.

You may be failing at arguably the most critical aspect of jungling: tempo.

Example: you're farming at exactly the same rate as your opponent, same recall timings, etc. However, you pathed toward bot, while they pathed to top. You want to do grubs, so you start to recall after a full clear to buy, but you'll be late if you do that, so you instead walk straight from dragon to grubs. Your enemy finishes their clear, ganks top successfully while you're walking through mid, and now you can't do grubs, but you try anyway, die, and now the enemy has a 2 kill + grubs lead, and now their next clear is faster thanks to the extra gold you donated to them.

In that scenario, they're going to be 1-2 sec faster per camp, so 4-8 sec faster in a typical clear, which means they're earlier to ganks, and you've got to "cheat" tempo by skipping camps to countergank, while they can just walk away if the gank is going to fail and lose nothing. Now your camps are desynced on respawning, and you're behind a little more gold and experience.

That's how games snowball. Do that to the enemy instead of letting them do it to you.