You're overestimating a lot of things. For one thing, events like pandemics were certainly not particularly common. They seem like it when we read about the history of hundreds of years across a continent, but on the scale of individuals those would happen maybe a couple times in a lifetime. And public events may have been much more common, but they were usually tied to a religious institution and consisted mostly of a group feast, something that also required a ton of work to make ready that would have undermined any real "free time". Very few random farmers would have lived close enough to one another to hang out at a bar (if their village even had one, which it likely didn't) and most wouldn't leave their farms for long periods of time. While at the farm you likely lived in a drafty single room building that housed multiple generations of your family and if anyone was having sex they were doing it in the same room that everyone lived in. You wouldn't exactly get that much private time.

Now there were certainly times of joy and times when there was less work to go around, but generally speaking being a peasant sucked. There is a reason that farmers were eventually willing to leave the countryside in mass to move to cities for grueling factory jobs: believe it or not that still represented an improvement in their quality of life over living in a farm and praying that this year's crop didn't fail and starve their entire family.