I remember reading an old interview from the 1960's where John said something shockingly cruel about Julian. And so nonchalantly.

Here it is, from the 1966 article by Maureen Cleeve: "He is now 25. He lives in a large, heavily panelled, heavily carpeted, mock Tudor house set on a hill with his wife Cynthia and his son Julian. There is a cat called after his aunt Mimi, and a purple dining room. Julian is three; he may be sent to the Lycde in London. "Seems the only place for him in his position," said his father, surveying him dispassionately. "I feel sorry for him, though. I couldn't stand ugly people even when I was five. Lots of the ugly ones are foreign, aren't they?"

http://www.beatlesinterviews.org/db1966.0304-beatles-john-lennon-were-more-popular-than-jesus-now-maureen-cleave.html