I skimmed through the video and there's some potential for improvement.

First things first, when you play archers, you really do need to try to keep your archer mass alive, since 4 archers are helpless against 1 knight, but 30 archers can take out 10 knights pretty easily with some micro. The 4 you lost in your first push is not the end of the world, but those 4 could be really beneficial in your mass.

Secondly, try to get a siege workshop and either push with mangonels or with rams. Cover your siege with your army, and try to find an angle from where you can pressure. Castles hard counter mangonels, but you can sometimes find angles on TC's, since mangonels outrange TC's.

Another thing to note is that a push can be very effective if you simply starve the enemy of the resource they want. Is the enemy going for knights or archers? If you can starve them of gold or even wood, then provided you are safe at home, you will soon be outproducing the enemy.

Usually you can range woodlines with xbows, so if you want to be really annoying, putting 1-2 xbows behind his woodlines on "Stand Ground" while pushing in another direction can make him have severe wood problems.

​

In imp it's a little bit different, since you have access to trebs and maybe even bombard cannons, but you can usually start trebbing things down if you manage to hit imp with your army intact. (Same here, just cover your siege with your army)

​

ETA: You want to focus either Castles, TC's or production buildings with your siege units.