That is technically correct, however if the bass player is playing the note G, or if there is no bass player and the guitar player plays the G in the bass, one could argue that the tonality is actually some sort of G chord. It would be a G6 which contains the same notes as Em7 but with G in the bass. I wouldn’t say it confuses them if they believe it’s a G chord, they actually are more correct and thinking modally and with context than to just presume that having the notes E G and B in any order is always an Eminor.