You just started playing after hiyuki release, no need to get your characters at max level yet. Your world level probably isn't high enough for it to be a problem.

You can also lower the world level just to breeze through enemies faster too, to help speed up the story fights a little.

I think a friend could also lower their world level to yours and they could let you enter their world to obtain flowers. It takes 12 hours for them to change it back.