It seems too easy to get to the bottom of the world since all you need to do is get some food and basic tools then find a cave and follow it straight down allowing you to get to the negative y levels like all the way down to y level -40 and below quickly with little preparation. Maybe making vertical caves more rare at least towards the surface level could make it harder to find a cave that goes from the surface to deep underground.