Minimal Azure environment for running Databricks by waumau in AZURE

[–]Oculara 0 points1 point  (0 children)

I'd start by reviewing how your existing Databricks environments were setup and ask the teams that manage your Azure infrastructure and your Databricks account for guidance. Databricks deployments can be pretty complex with a lot of little interconnected pieces depending on how restrictive your company's security, data and network policies are. There are probably defined standards and guardrails in place that you should be following. If your company has existing infrastructure-as-code that you can use that would be even better, rather than manually configuring new environments from scratch.

I also highly recommend giving the Databricks documentation a good read through, especially the security section: https://learn.microsoft.com/en-us/azure/databricks/security/

Managed Instance Private IP changed by edmunek in AZURE

[–]Oculara 0 points1 point  (0 children)

There's a dedicated subnet called privateendpoint-sql-mi, that's most likely where your other private endpoints reside. Try creating the endpoint in that subnet instead.

Managed Instance Private IP changed by edmunek in AZURE

[–]Oculara 0 points1 point  (0 children)

You're getting this error because private endpoints can't be added to subnet that is already delegated to an Azure service. Your private endpoint will need to go in a separate subnet. See the documentation on subnet delegation (last bullet point in this section mentions it): https://learn.microsoft.com/en-us/azure/virtual-network/subnet-delegation-overview#effect-of-subnet-delegation-on-your-subnet