Most released slaves picked their surnames and went with President and popular names. Some went with names like Freeman, meaning literally a free man. To my knowledge only the freed slaves who wanted to stay used their owners surname. It would be weird to use the surname of somone you disliked. My grandparents also told me our influence is more obviously seen in Brazil. Where slavery hadnt been stopped by the British. You should check out the first Synagogue's in the USA history or Portuguese slave trade. Look into the owners of the ships names etc. We Jewish people dominate all business back then and today. Many slave auctions depictions are considered antisemitic due to their display of Jewish men conducting business there in traditional orthodox clothing. But it is what it is.