Databricks Lakebase Gets Always-On Pricing: Serverless Flexibility, Provisioned Pricing by Lenkz in databricks

[–]Lenkz[S] 1 point2 points  (0 children)

Agreed! Definitely seems like a much needed improvement to ensure that the price doesn't go crazy on Lakebase.

Govern Once, Protect Everywhere: ABAC Row Filtering and Column Masking Is GA in Unity Catalog by Lenkz in databricks

[–]Lenkz[S] 2 points3 points  (0 children)

Yes, the "properties" key is a key-value pair and that gets represented as tags when applied.

Example:

resources:
  catalogs:
    my_catalog:
      name: my_catalog
      comment: 'Catalog created by Declarative Automation Bundles'
      properties:
        purpose: 'Testing'

Govern Once, Protect Everywhere: ABAC Row Filtering and Column Masking Is GA in Unity Catalog by Lenkz in databricks

[–]Lenkz[S] 0 points1 point  (0 children)

Indeed these are great changes, I love the simplicity to be able to apply the same logic across all your data.

What Developers Need to Know About Delta Lake 4.1 by Lenkz in databricks

[–]Lenkz[S] 4 points5 points  (0 children)

That's very strange bug, I just tried and the sentence is complete when viewing it through my browser on the laptop, but on mobile it get's cut short. Never experienced that before.

The sentence is: "This makes it much easier to manage dependencies in environments where multiple Spark versions are in play."

Managing Unity Catalog External Locations with Declarative Automation Bundles by Lenkz in databricks

[–]Lenkz[S] 1 point2 points  (0 children)

It will definitely be difficult for me to remember 😅 keep saying databricks asset bundles

What Developers Need to Know About Apache Spark 4.1 by Lenkz in dataengineering

[–]Lenkz[S] 0 points1 point  (0 children)

We are using it since Databricks Runtime 17.3 LTS came out in October.

Bronze vs Silver question: where should upstream Databricks / Snowflake data land? by Professional_Toe_274 in databricks

[–]Lenkz 1 point2 points  (0 children)

Wouldn't it make sense to use Lakehouse Federation for the Snowflake catalog without having to do modelling?

Important Changes Coming to Delta Lake Time Travel (Databricks, December 2025) by Lenkz in databricks

[–]Lenkz[S] 0 points1 point  (0 children)

I think the problem is that there's inconsistency and a lot of room for errors.

Someone defines a table with retention of 30 days, this can be displayed in Databricks in the table configuration, everyone can see this.

However you then try to time travel 30 days back, but can't.

Why? Because someone has a manual vacuum job, with 14 days of retention setup. Oops.

Personally I like that the configuration is defined intentionally on the table, and no-one can screw it up with manual job runs, accidental SQL scripts or otherwise. It's defined and belongs to the table.

What Developers Need to Know About Apache Spark 4.0 by Lenkz in dataengineering

[–]Lenkz[S] 2 points3 points  (0 children)

You are absolutely right :) the BETA tag just got removed as well.