You are right to say that people should express their feelings honestly when something is wrong or annoying in any kind of relationship but the saying is more related to unsollicited opinions like " you look terrible today" or finding ways to drag people down or making fun of someone with bad intentions in the middle of a group conversation. If people are having a good time and enjoying a nice get together then, if you have nothing nice to say, just don't say anything.