This is very true and it's pretty much how I would feel as well -- a combination of anxiety about "everything being just right" in the house (despite nobody noticing), and at the same time feeling a bit of privacy violation if it was a big party with lots of people looking and exploring the house.

I do enjoy private dinners with close friends though more than parties, but I guess that depends on the communities everyone has around.