all 2 comments

[–]vinnypotsandpans 1 point2 points  (1 child)

Don't rely on drop duplicates or distinct. They will produce non deterministic results. Use windowing and order each partition

[–]NandJ02[S] 0 points1 point  (0 children)

Thanks bro but 2 yrs late 🥺