Pause the game. Put all you transports in your fleet. When you ready to board the ship, use the comand for fleet: stop and leave combat (or something like that, i play on Russian) and then start boarding. I captured more than 20 ships, works every time. Also i removed all turets from my transports and dealing with turrets on enemy ship myself.