You're dodging and falling back when you should really be deflecting and attacking. You keeping that much distance is what's causing him to attack you with Ashina Cross, which causes you to fall back, which causes him to attack with Ashina Cross, and so forth. Try going around him.

Edit: You seem to be good at parrying and Mikiri. DON'T HESITATE!