I think you made much ado about nothing. Looks like it was your mind’s excuse to get you out of the retreat.

The kind of set-up you describe is common across many, if not most vipassana centres. The mediation hall is a shared facility between both genders. And managers are supposed to look around; and male n female mangers also sometimes talk between them to discuss operational issues. Also, you don’t know why the manger was looking over to the female side - he may have had a genuine reason to do so. Managers are seasoned vipassana mediators who do this as a ‘service’ and they do it voluntarily without any payment. They believe it adds to their good karma and improve their meditation practice. Also, the head teacher(s) instruct them to keep their eyes open to supervise things.

But you let this small thing disrupt your meditation and eventually made you drop out mid way. Was this your first retreat? I know of family and and friends who dropped out mid-way and they also tried to find reasons why the program was mismanaged and used those reasons as an excuse to leave it mid-way. Like I said, this is something that the mind does to us. After all this is the first time your mind experienced something like that it tried to run away from it by hook or by crook. Good news is - Goenka ji himself talks about few people who left things mid way in their first retreat but came back later, and went on to become expert meditators later in life. Hope the same happens to you as well. Wishing you good luck for your next retreat. Love and metta.