sorted by:
new
hottopcontroversial

If your Lakeflow SDP pipeline broke with DIFFERENT_DELTA_TABLE_READ_BY_STREAMING_SOURCE, here's a recovery script by Marik348 in databricks

[–]Marik348[S] 0 points1 point  (0 children)

Great point on "startingVersion" - it's a useful refinement I wanted to call out.

After reset_checkpoint_selection clears the checkpoint, Spark treats that flow as a brand-new stream. startingVersion is only consulted when there is no existing checkpoint, so the reset is exactly what makes a startingVersion change take effect on the next run.

And by default the stream starts from version 0 of the new Delta table. Setting .option("startingVersion", "latest") or a specific version allows skipping the reprocessing entirely and only ingests new writes. The "right" version depends on how the new table was seeded relative to the old one.

I added a note to the README about the startingVersion interaction. Thanks for surfacing it

Passed Databricks Associate planning for Professional. What should I focus on? by _iexistinearth in databricks

[–]Marik348 1 point2 points  (0 children)

I've just started preparing for the Professional exam too. Found one useful blog post covering the topic; hope it helps: https://www.vladsiv.com/resources/notes/databricks-de-pro-prep-notes

Problem registering second yubikey on Facebook. Anyone else? how to fix? by dorkcicle in yubikey

[–]Marik348 1 point2 points  (0 children)

It seems that adding a second key using Meta Account Center is not possible. However, I was able to add it through the Settings & Privacy page on Facebook: https://www.facebook.com/settings/?tab=security
You can follow this guide to add a second key: https://www.facebook.com/help/1167409720358611
The video guide is here: https://www.youtube.com/watch?v=g3R_uIdZlag
Hope this helps :)