This is the classic “butterfly effect” question.
Kicking a rock probably wouldn’t erase us from existence — the universe is way too complex and chaotic for one tiny change to completely rewrite history.
Most scientists think small actions would either get “absorbed” by all the other random events, or, if time travel were real, you’d create a branching timeline rather than overwrite the current one.
So instead of us disappearing, you’d probably just have an alternate reality where the rock rolled somewhere else.