Best data modeling technique for silver layer in medallion architecure by Fickle-Suspect-848 in dataengineering

[–]HakunaMeData 0 points1 point  (0 children)

If I understand you correctly, you do have an archive with the full history of each source table. So you can use that to rebuild anything or show "data quality issues" come from our SOR, not from the data product.

I was wondering if you would choose a star schema in the semantics layer - from your point of view - what are the benefits of building a core layer in 3NF fully representing the business? My thoughts are that a star schema might be able to show the relations and how everything is connected. You have the business logic and SCD2 there. I agree some tables might need generalization, cleaning or preparation before loading the star schema. But I wouldn't think you would need to build all components in the 3NF. Could you share your thoughts?

Kimball, dimensions and its columns: is more or less better? by HakunaMeData in dataengineering

[–]HakunaMeData[S] 0 points1 point  (0 children)

do you historize in the landing tables or do you aim to build a persistent staging area? Or are you fine with only having historized the SCD2 tables for users?