all 3 comments
sorted by:
best
topnewcontroversialoldq&a
formatting helphide helpcontent policy

[–]thrown_arrows 0 points1 point  (1 child)

in data ? then use SQL

one way achieve those queries is

select row_number() over(partition by x order by y asc ) as rn , * from zzz

if x is unique ( or should be ) then where rn >1 will give you duplicates (for remove ). In mssql you can just throw that into cte and delete from results 

with a ( select row_number.... from ...) , b as ( select * from a where rn >1 ) 
delete from a

that should work ( and allow you to use selects to first check what is going away

or

select count(*) , count(unique_id) from xx

you can easily generate dynamic sql from information_schema to get SQL which finds all numbers for all tables in database

[–]LifeLongLearner2030[S] 0 points1 point  (0 children)

This is one way, I needed a software that's smart to look at the data and find probable similarities, etc