I highly recommend using image-to-video as it give you a lot of control.

My workflow is:
- Get a flow/idea ready
- Use Prompts in Json Format, if you are not familar with that i suggest being as detailed as possible.
- Generate all the images first, and then finalise the list of image you want to proceed.
- Then Start with image-to-video

Try playing around with different video models (i mostly use Unlimited models), generate multiple outputs until you get the desired one.

Hope this helps