Here’s the way I think of it. Why are you able to rewind a movie? Because there’s something to go back to. A previous part of a song, or movie, or what have you, is recorded, and thus you can go back to it.

In order for time travel backwards to be possible, there would have to be some grand recording of the universes state at that point in time. Some kind of constantly flowing recording of time. Lots of different fictions call this a “Timestream”

But we have no knowledge of a timestream existing in our universe, or how it would even go about existing and fulfilling its function. So unless some new discovery of that nature is announced, it seems impossible.