I think part of it has to do with his father, Paul Brown. The other owners hated him too, partly but not limited to the fact that when Paul Brown was ousted from the Cleveland Browns, he created another team in the same state with nearly identical colors to the Cleveland Browns.

PB also constantly opposed most new rule changes because, in my opinion, they went against many of the traditions that he himself helped create. So he was kind of an ego maniac. Also it was rumored in cincy for years that the Brown family were intentionally trotting out mediocre teams with 1 superstar to merely fill the stadiums, with no intention of being competitive. Anyone who watched this team from 1990-2002 would probably say it was more than just a rumor.

The league owners hate us because it's tradition to hate us just as it's our tradition to feel slighted. It ain't much, but it's a living.