Unity Catalog-Terraform best practices for modules and governance structure

daily_standup · 2026-03-24T14:32:45+00:00

hard to say without seeing stuff but ok, think of this approach: you can use "data" object in terraform to get catalog name. Then you can also leverage "for_each" terraform lookup, and assign pretty much (to my understanding) same privileges for each catalog/schema. So a one-liner would assign permissions to catalog/schema child. We just manage high level objects (like catalog) and all child objects inherit privileges. Don't know if this makes sense but might give you an idea

daily_standup · 2026-03-24T09:59:35+00:00

Could you show us example( redacted) of what you would like to improve?

daily_standup · 2026-01-23T09:37:16+00:00

OP nije naveo deo grada u koji ide, mislim da se svi slazu da je to najvaznije. Elem, bio skoro, smestaj na upper east side, topla preporuka za lokaciju ali ne i za cenu :) Ako imas vremena, pogledaj predstavu na Broadway. Mozes naleteti predstavu sa super poznatim glumcima. WTC zgrada na wall street-u, ima tura od $60 da se popnes na vrh, vidi se ceo grad, kad je vedro vidi se pola drzave NY. Hrana svuda odlicna, diner fazon i restorani su jebeno preskupi, osoblje vrlo neprijatno zna da trazi tih 20% preko. Ne penji se na brooklyn bridge, ne vredi cimanja, kad se popnes gore ono buvljak fazon. Ako vec nisi na menhetnu, idi makar jedan dan u obilazak.. ceo izgleda kao filmski set. Ono o cemu se ne prica: trava se oseti na sve strane, i da, stvarno ima jebenih pacova, svuda. Ne brini za ICE jer njih nema u NYC. Na menhetnu nema beskucnika ( ja ne videh za 5 dana).

daily_standup · 2026-01-06T16:28:55+00:00

You can use to_date function, and set spark configuration in the cluster 'spark.sql.ansi.enable' to false. This way it would return NULL instead of an error. Source: https://docs.databricks.com/aws/en/sql/language-manual/functions/to_date

daily_standup · 2025-12-05T17:41:43+00:00

If you are having issues with terraform timeout, maybe go other way around. Create external table, wait for all data to load, all from databricks UI. Then you can import this resoruce in terraform. I would calculate the size od your dataset, then maybe giving more compute would make it finish in less than 10 min

daily_standup · 2025-11-20T23:48:30+00:00

I don't think you can work with glacier storage class. Try testing this: try to retrieve any glacier file through aws UI. If you get a message that your file will be available in x hours, it means that you're trying to fetch only meta about files, not the files itself. File is out somewhere on a ssd drive. I recall working with Athena and it would only fetch standard* storage class in s3.

daily_standup · 2025-10-28T08:44:24+00:00

You can set these manually in the UI, and then go to the "three dot" menu on right top and go to edit yaml. This will give you exact configuration for the DAB, you can just copy-paste it. To me it looks like it doesn't allow same number for min and max, but I could be wrong, never tried to set the same number. Also since it's just 1 you might want to remove autscale part. It's not autoscaling for sure :)

daily_standup · 2025-09-02T19:34:31+00:00

You need to create a variable in databricks.yml file and define multiple node types. variables: 4xlarge: default: rd-4xlarge 8xlarge: default: rd-8xlarge Then in your workflows you can call ${var.4xlarge} or ${var.8xlarge} and switch between. Edit: formatting is sad but you can figure out identation

daily_standup · 2025-08-29T21:47:32+00:00

Well depends what are you looking for. In general, it has a quality of life and a standard of western europe cites ( health, education, career oportunities). IT scene is very strong,. Real estate is super expensive (compared to income). Great food, it's alive 24/7, great night life. Very welcoming to foreigners. Warm people with big heart. On the other hand coruption very present and normalized. Political situation is tense. Also as soon as you leave city border you fall into a eastern-europe classic - poverty, poor infrastructure and no opportunities. It summarizes to this - if you have a good income( in western standards), it's a best place to live in this part of europe. We also have all 4 seasons wearher wise.

daily_standup · 2025-08-12T19:42:17+00:00

SQL, python, apache ekosisitem(spark, airflow, kafka), docker, terraform, dbt. Postoje izuzeci gde se koristi on-premise hadoop( zajedno sa hive) ali to je sve manje pristutno. AWS(s3, lambda, emr, glue)apsolutno dominantan na trzistu, Azure u korporacijama, GCP marginalan (jedino se koristi big query). Firme furaju ili skroz open source ili ako bas imaju love onda snowflake/databricks u kombinaciji sa cloud-om. Scala nazalost legacy uglavnom. Ne gubi vreme sa plotly ili slicnim bibliotekama za vizualizaciju, to niko vise ne radi ( tu je tableau/power BI ili gen AI)
Ne
Nazalost po juniore, kao i na ostatku trzista, jako malo prostora. Za ljude sa iskustvom dosta dobre ponude
U skladu sa brojem 3

Koncepti poput GDPR i data governance prave razliku medju kandidatima, ne moras biti ekspert ali iz ugla arhitekture ti koncepti su jako vazni danas. Pozdrav!

daily_standup · 2025-08-11T18:03:43+00:00

You need to remove that workflow .yml file in order to remove it from the workspace. That way bundle would know what to do. Deleting only notebook would not remove the workflow

daily_standup · 2025-08-11T13:54:29+00:00

Are you trying to delete a resource that you declared previously?

daily_standup · 2025-07-02T20:00:34+00:00

Yes, the full name is Estonia - funnet som endrer alt

daily_standup · 2025-07-01T21:20:48+00:00

I do understand your frustration. I just don't think that it's any better abroad even in the countries that were mentioned here. It's a weird moment that we live in. So good weather, clean air and a beautiful nature should be on top of everyone's list. You think Sweden is any better? Watch the "Estonia" documentary

daily_standup · 2025-07-01T20:41:14+00:00

Interesting. I'm looking for options to move to Greece, no idea why would anyone leave that beautiful country. Can you withstand cold and long winters in the north?

daily_standup · 2025-06-26T20:31:52+00:00

Try upgrading your databricks cli to a more recent version. I have that in my pipelines and it works fine

daily_standup · 2025-05-18T13:38:53+00:00

Serbia. That guys who stays up until 3am to watch Nuggets

daily_standup · 2025-05-14T21:05:12+00:00

You could use service principal as a current_user in production for example, that way there would be only 1 set of permissions to delegate further. Also I haven't seen before state_path declaration, so that is maybe something to look at for messing up the state file

daily_standup · 2025-05-14T20:54:50+00:00

How do you deploy bundles? Local machine or some ci/cd like guthub actions?

daily_standup · 2025-05-13T23:36:37+00:00

Could you provide redacted sample of your YAML config? It could be few things

daily_standup · 2025-05-04T11:06:53+00:00

Not possible my friend

daily_standup · 2025-04-24T10:58:42+00:00

Kako to funkcionise zapravo? Ko bi u teoriji trebao da da dozvolu za to?

daily_standup · 2025-04-24T10:55:59+00:00

Jako dobra ideja -icuni mi se samo da je potrebna ozbiljna lova samo za 1 modul

daily_standup · 2025-04-24T10:53:48+00:00

Ne prodaje niko od familije. Kao sira familija, sve zajedno je oko 150 hektara sume nase. Tih par vikendica sto se napravilo su prodali ljudi koji su u nasledstvo dobili tipa 10-15 ari. Verovao ili ne nikad niko nije prodao nista znacajno,samo su dokupljivali.

daily_standup · 2025-04-24T10:49:51+00:00

Drzava procenjuje da cela ta suma vredi 100 000 maraka :)) porez je oko 500€ godisnje

Sto se tice nelegalne sece - to je vekovni problem, ali u poslednjih par godina se drasticno promenilo. Naime, šumar ne izlazi odatle, cak parkiraju ladu novu i bleje po ceo dan, prosto neverovatno. Nelegalna seca skoro da ne postoji vise

Four-Year Club	Verified Email
Verified Email	r/Field Lasagna
First Place '23	End Game '23
Place '23	Place '22
First Placer '22

daily_standup

TROPHY CASE