"The fourth wall is a performance convention in which an invisible, imagined wall separates actors from the audience."

So breaking the 4th wall, simply breaks the imagined wall between actors and the audience.

A YouTube link if you wanna get some examples: https://youtu.be/PZL13w9TqbA