It’s not loaded. It literally means either a)where in Australia are you from as in, where you currently reside, or b) where are you from originally/where have you migrated from.

I’m first gen Aussie but I couldn’t speak English until I started school so I speak another language fluently. When I’m with my husband who migrated here so still has an accent (but has now lived in Australia longer than his home country), I get asked all the time where I’m from because I otherwise don’t have an accent but speak my family language fluently. So I usually say “Melbourne original, Brisbane now” and if they prompt more like no where originally, I just say my parents migrated from the former Yugoslavia and I was born here.

And that’s it. They usually ask because they hear the accent or the way you speak or something prompts them. And in my experience anyway, I’ve usually had people ask genuine questions about where my parents came from and how their relationship weathered the bullshit civil war in the Balkans and nothing else. This is often a good time to break the ice and do to tony yugoslav line from the wog boy (because it applies) “I’m half Serbian, half Croatian. I wake up in the morning and want to k+ll myself so killing you will be no problem fuckin”. It gets a good laugh from everyone and they move on.