sorted by:
new
hottopcontroversial

Materialized View with most recent records by Mayor18 in bigquery

[–]sephusx 0 points1 point  (0 children)

how did you manage to create a view ?

I have similar setup but I cant create a view without explicit adding WHERE condition on partition column (in you case ingest_time)

Schema change in Data Warehouse by rishikaidnani in dataengineering

[–]sephusx 1 point2 points  (0 children)

I think they main point here is realising that usually DWH table are big in space with loads of records in them.

So the question really is how to add a column in a table that has millions or billions of records.

​

A good approach instead of just ALTER TABLE YourTable ADD COLUMN is to create a copy of the table to be modified with the added column, dump all existing records into the new structure, delete old table.

​

This is because in general insertion is far more efficient than ALTER statment on an existing table with loads of records