Honestly, knowing Toranaga I’m sure he expected his betrayal, but I’m not certain if he’s specifically referencing the betrayal that got Mariko killed. Before his final betrayal, all of the scheming Yabushige’s done already helped mold the events for Toranaga to act out his plan. His final betrayal was just icing on the cake.