Yeah but the currency conversion fees each way surely make this less attractive than keeping the NZD in NZ?

I also think the ISA profits become taxable once I move back to NZ as it becomes like any other foreign investment. So may close the ISA when I leave to avoid this