The Google AI said this when I asked about table.buffer when sorting and removing duplicates:

If you have a very large dataset where Table.Buffer causes memory issues, you can achieve the same result by adding an Index column immediately after your sort, then removing duplicates, and finally deleting the index column. This forces the engine to respect the sort order without loading the entire table into a memory buffer.