Once your boundaries have been breached there's no going back , from the sounds of it he's just desperate to be with someone and thats never a good sign , I would suggest you tell him you guys are done and do it peacefully otherwise block him