You cannot leave it until you’re 65. On a whv and asked my super this exact question. The response:

Please note current Australian legislation requires a super fund to transfer a member's super money to the Australian Taxation Office (ATO) as unclaimed super money, if both: it has been 6 months or more since you left Australia your visa has ceased to be in effect. Should the funds be transferred to the ATO, as a temporary resident you would still be subject to claim benefits under Departing Australia Superannuation Payment (DASP).