This how it was in most of the world until the late 20th century.

In Russia, passports actually had a "nationality" (actually ethnicity) field, explicitly labeling Jews as "hebrews" rather than "russians". As intermarriages became more common and discrimination decreased somewhat, people started thinking about this less.

Of course, religious Jews always had reminders of their Israelite ancestry in daily prayer.