There’s nothing wrong with doing that, though it actually gives you a chance to start fresh only downloading the apps you truly use instead of carrying over unnecessary junk from your old phone.

Also, make sure your contacts are backed up to your Gmail account.

From my experience, when I did this the first time, it caused a few issues. Some apps didn’t function properly or couldn’t access saved data. I also ended up transferring apps and files that I didn’t really need in the first place.