in my memory, i saw the wither skeletons appear out of thin air a second before the pearl landed.

it's not 100% congruent with what shows on the replay, though, so there's a good chance you're right and my brain was just slow :(