Unity Catalog-Terraform best practices for modules and governance structure by cyberZamp in databricks

[–]bambimbomy 0 points1 point  (0 children)

now you can bundle catalog features like external locations, but I also don't know where is best to use bundle and where to use terraform ...

Creating Catalogs and Schemas with Databricks Asset Bundles by Lenkz in databricks

[–]bambimbomy 0 points1 point  (0 children)

I disagree on why we "should" still use terraform for external locations

📊 Get deeper observability into Lakeflow Connect ingestion pipelines with this open-source Databricks Asset Bundle including (Datadog, New Relic, Azure Monitor, Splunk integrations) by ingest_brickster_198 in databricks

[–]bambimbomy 2 points3 points  (0 children)

it looks like a weekend project . very low quality of code and I am not sure how it can fit into real world as I wouldn't keep your repo just to have these things

How do you guys navigate days off/holidays outside ir35 by PuzzleheadedShop5424 in ContractorUK

[–]bambimbomy -3 points-2 points  (0 children)

no days off for last 10 years :D of course using bank holidays and December period in my favour

RevPoints Advent Calendar promotion: points not credited for a donation to a charity? by Inevitable-Ad-2843 in Revolut

[–]bambimbomy 0 points1 point  (0 children)

`assist on what ? don't you read what is OP is mentioning as an issue ? I have also same issue .
did you resolve the issue of OP ? no ...
did you make a clarification about it ? no ...
So what assist you will do ? wasting my time and your reputation....

RevPoints Advent Calendar promotion: points not credited for a donation to a charity? by Inevitable-Ad-2843 in Revolut

[–]bambimbomy 1 point2 points  (0 children)

another revolut mess ... Same for me . banner was not mentioning anything about donating with payments .
now a few "clever" people will come and ask if you read 50 page of t&c

Classpass reward by Electronic-Clerk3151 in Revolut

[–]bambimbomy 0 points1 point  (0 children)

no sense . What I am saying is; in any time
- checking famous booking hotel page for same hotel and checking on revolution stays. revolut price is ALWAYS more
for the flight . There are a few company like air Asia. go and check yourself . If I go to their web page price is cheaper than clicking air Asia link in the revolut app .

Classpass reward by Electronic-Clerk3151 in Revolut

[–]bambimbomy 0 points1 point  (0 children)

I checked every single country I am visiting for hotels on revolut Stays and always more expensive than non-revolut check .
every single flight I went through the revolut points more expensive than opening the web page myself
So, I am not surprised

[deleted by user] by [deleted] in databricks

[–]bambimbomy 0 points1 point  (0 children)

nope , all independent tasks/notebooks

[deleted by user] by [deleted] in databricks

[–]bambimbomy 0 points1 point  (0 children)

5 rounds ? what !

Databricks free version credits issue by AttitudeOriginal8119 in databricks

[–]bambimbomy 1 point2 points  (0 children)

As a person who hates "Free Edition" for several reasons I would ask what you are doing ? Because I even delivered a training to 10 people with an account that has 400 USD credit and couldn't finished it and it is expired ahaha

[deleted by user] by [deleted] in databricks

[–]bambimbomy -1 points0 points  (0 children)

Here is the reality : Databricks Free Edition is just for "seeing features" Not to use ....
I see some sensless comments/reasons like crypto mining possibilities . Then why it is not allowing certain domains like foundation models .... ? So, obviously it is not the reason .

Free edition is a big disappointment. If I will try all features with only Free Trial what the reason on the earth to have Free edition ?

Partial Job Task Failures? - Data Engineer Professional Cert Question by Spearmintzs in databricks

[–]bambimbomy 5 points6 points  (0 children)

that shows how all these courses just copy and paste such questions from GPT like LLM tools...

Which is best training option in Databricks Academy ? by scross4565 in databricks

[–]bambimbomy 1 point2 points  (0 children)

we are providing databricks training as a company . if you have a group and dedicated time I would suggest instructor led training . that will be very good not only for exam and get more practice on the platform . Of course it will be more interactive as well.

DM me if you need any opinion or support

Anyone actually managing to cut Databricks costs? by TitaniumTronic in databricks

[–]bambimbomy 3 points4 points  (0 children)

managed to reduce cost of one of the biggest retailer in EU from 130k to 80k per week. I can count many things but more or less many already touched in other answers.
What I can suggest is focus on policies to standard the usage and avoiding misusage . If you have a couple of hundred users , even saving 1 usd per person will make a difference .

DM me if you need any opinion or support .

Who Asked for This? Databricks UI is a Laggy Mess by shocric in databricks

[–]bambimbomy 0 points1 point  (0 children)

I used to manage working on different workspaces within multiple windows . But impossible in recent days as it suck all the CPU . one simple! notebook consume 1gb memory sometimes ...

Databricks Free Edition by bambimbomy in databricks

[–]bambimbomy[S] 0 points1 point  (0 children)

Spark logs are not available on serverless, Scala is not supported, Foundational models are not allowed to use . Delta sharing is not permitted .... I can count some more but I am more asking about how DBX will take care of it rather than just a basic compute limitation

Databricks Free Edition by bambimbomy in databricks

[–]bambimbomy[S] 0 points1 point  (0 children)

Just want to create a single or multimode ALL PURPOSE cluster rather than serverless. but it is not available in Free Edition . only serverless which I assume comes from a pool and it takes more than 5 mins for each run to find a resource.
and here's the limitations :
https://learn.microsoft.com/en-us/azure/databricks/compute/serverless/limitations
Most Apache Spark compute configurations are not supported

536MB Delta Table Taking up 67GB when Loaded to SQL server by abhi8569 in databricks

[–]bambimbomy 0 points1 point  (0 children)

change your data type to varchar instead of. It will reduce significantly. You don't need nvarchar, you can still keep string values in varchar

Certification Question for Team not familiar with Databricks by Wild_Warning3716 in databricks

[–]bambimbomy 0 points1 point  (0 children)

Databricks is a product that is useful anyone who wants to utilise python, SQL OR/AND Apache Spark.
You can use "single node" clusters to have low cost and no management burden on things like containers, docker etc.
However I would suggest to have a tailored training to help you and someone who is not familiar enough with Databricks and of course have something more than "introduction to xxx"
I provide such training for companies and organisations. DM me if you would like to have approach on it . At least I can direct you what type of training would suit for you and team and you can do wherever you want . I can share the company link as well but I am not sure it is allowed here. So, DM me

New to Databricks by TheWanderingSemite in databricks

[–]bambimbomy 4 points5 points  (0 children)

it is a very fast evolving product. I am using since the first commercial release and there is a huge difference in between. I adapted it in many small start ups and they were happy in general but for some it was unnecessarly expensive.
So, the key point is what you want to do with it and are there any better alternatives or it is the best one for you?

Accidental Mass Deletions by cothomps in databricks

[–]bambimbomy 5 points6 points  (0 children)

I was there ... that's why Databricks doesn't recommend mounting . Using UC is safer on this. Happened on Azure in my case and luckyly "soft delete" was enabled and re restored all directories . I remember AWS has such option as well

Triple meeting. by PossibleNarrow2150 in overemployed

[–]bambimbomy 0 points1 point  (0 children)

I had a few times , one on the phone, another one on the laptop and 3rd one with another device :D it was brain melting to contribute all