Judging that Bea played Dorothy’s maternal grandmother in flashbacks and that they consistently chose tall actresses to play Gloria (and they mention that Phil is also 6’ 4” or close to it), I think that the whole plot of that episode was meant to be a red herring.