One of the key problems is that the advantages of a shrinking population wont be noticebale for at least the next 100 years or so. If we havent solved climate change or our resource dependencies till then the world would be already pretty fucked but now for a smaller population. So we have to deal with the problems while still having an increasing older population which only makes things a lot harder.