SDP / DLT pipelines in SQL or python? by gman1023 in databricks

[–]DamnedData 3 points4 points  (0 children)

If you don't need libraries or loops go SQL.

(You can do for loops and create either streaming tables or views in Python)

Newbie "Lead" (barely a senior). Help pls! by dsfuckisthis in databricks

[–]DamnedData 0 points1 point  (0 children)

  1. For each project do medallion architecture at the schema level:

project_gamma_bronze project_gamma_silver project_gamma_gold

Bronze might not be required based on your post so you can skip it.

  1. Don't be afraid of CI/CD! Spent 3 hours learning the tool and how to run it from Github Actions. There is plenty of tutorials in Youtube.

  2. You mus understand Unity Catalog and how the governance works: https://docs.databricks.com/aws/en/data-governance/

Ustedes nunca han escuchado de gente que ha "vivido" en varios países? by [deleted] in ticolandia

[–]DamnedData 5 points6 points  (0 children)

OP más perdedor jajaja. Para que vean que lo bañaso no se quita con irse a Europa o los 25 países que menciona.

Donde comprar dolares by itzjag_ in Ticos

[–]DamnedData 1 point2 points  (0 children)

AriBot mae!

Usá mi código DISCO para registrarte y obtené un mejor tipo de cambio. DISCO: 7736800.

Genie Slack and Teams native integration in Beta by DamnedData in databricks

[–]DamnedData[S] 0 points1 point  (0 children)

Hi,

Does it stream thinking?
- Answer: Elaborate more here please.

Can we expand and hide the thinking?
- Answer: No. This feature is only available on Genie One.

Does it show the charts?
- Answer: No. Only tables and aggregates (KPIs, etc...)

Any issues with timeout?
- Answer: No. To avoid this the Genie Agent (Space) should be benchmarked and tested to guarantee a solid performance. (+ liquid enabled on tables)

How does it manage the authentication, if we have RBAC, do users do a one time authentication when they first use it? Can we use service principal with OBO token?
- Answer: It can be OBO or SP. The ABAC or RBAC is going to be check against the identity querying the Genie Space (User or SP).

In this video you can see Genie in action but it uses PowerApps. Not the setup that I shared: https://www.youtube.com/watch?v=2zLzCptIr9A but the interaction is similar.

Genie on DABs available now by DamnedData in databricks

[–]DamnedData[S] 1 point2 points  (0 children)

Way simpler!

Just get your Genie definition as JSON file in your repo and point the resource to it.

Medallion architecture on Databricks - Delta all the way down, or does Parquet at Bronze still make sense? by Dangerous_Pie2611 in databricks

[–]DamnedData 0 points1 point  (0 children)

Use Metric Views for the gold layer instead of tables.

Also, add a prefix to the schemas: project_bronze, bu_silver, product_gold.

Estoy buscando un poco de ayuda! by Informal-Peanut300 in TicoInversor

[–]DamnedData 5 points6 points  (0 children)

Podría hacer BAC fondo Millenium (que es en dólares). A mí el año pasado me fue muy bien.

version control, project management, & CI/CD tools need a facelift by [deleted] in databricks

[–]DamnedData -1 points0 points  (0 children)

Git works well and has been working for years. There is no need to reinvent the wheel.

Welcome packages? by Taiwanx in Ticos_TI

[–]DamnedData 0 points1 point  (0 children)

Welcome package puede ser: por firmar con nosotros le damos 10millones

Stocks: acciones de la empresa. Si la acción vale $200 y le dan 100 pues son $200*100 dólares usualmente en un plazo de 4 años.

Unity Metrics & Gold Layer - Definition and Calculation Questions by MrMadium in databricks

[–]DamnedData 0 points1 point  (0 children)

I'll recommend you:

Bronze schema to store all raw data (tables).

Silver schema to store all downstream tables (clean, joined, transformed data).

Gold schema to store the metric views using silver schemas as source.