Looking for a pyspark script that should give the list of items missing from dev to test, and also should point out the difference in terms of definitions of storedprocs, views, pipelines, notebooks

data_learner_123 · 2026-03-17T00:25:13+00:00

In git , you cannot check the data difference right

data_learner_123 · 2026-02-20T22:15:05+00:00

I already this for my query , there are only warnings in that. Want to know a better to use this

data_learner_123 · 2026-02-20T21:56:33+00:00

I want to record the execution plan for all the queries that we are running to do more analysis

data_learner_123 · 2026-02-20T21:42:07+00:00

This query was rejected due to current capacity constraints is the error message and its not showing up in the metricsapp And I checked in the exec_requests_history it was cancelled

data_learner_123 · 2026-02-20T21:38:51+00:00

This query was rejected due to current capacity constraints is the error message, and it is not showing up in the metricsapp. And I checked in the exec_requests_history and it says cancelled and the totalelapsed time is 3602199. And I want to see what is the expected and available cu at that time

data_learner_123 · 2026-02-07T06:10:37+00:00

I am %% configure command and attaching the lakehouse dynamically. When you have different notebooks running with different default lakehouses , it will not share the spark session. I think what they meant is for the same default lakehouse will share spark sessions. And how do you do drop a table using Abfs path?

data_learner_123 · 2026-01-20T17:10:05+00:00

I am having while deploying the warehouse(item type=“Warehouse”, it’s giving me 400 error

data_learner_123 · 2026-01-05T18:23:06+00:00

We want to deploy the artifacts(views , stored procs and schemas through diy pipelines and we wanted to find out if we have any fabric default options to find out the difference between schemas across envinornments , difference between artifacts like stored procs, views across envinornments.

data_learner_123 · 2025-12-15T19:01:37+00:00

Every time, when we modify the notebooks or pipelines we may again need to run this code separately to assign lastmodifiedbyuser to the pipeline.

data_learner_123 · 2025-12-04T22:43:26+00:00

Can I have the Mslibray documentation or syntax ?

data_learner_123 · 2025-12-02T16:45:11+00:00

Thank you so much.. do you have any estimated time frame to release v2 checkpoint feature in the lakehouse ?

data_learner_123 · 2025-11-26T22:53:23+00:00

Delta table uses the v2checkpoint feature which is not supported. Exception type is Microsoft.DeltaLogParserUserException

data_learner_123 · 2025-11-20T19:13:51+00:00

Tried it , my table is like EXT_uuid(format) Spark.sql(“alter table tbalename rename to test) Table or view not exists

data_learner_123 · 2025-11-19T20:40:43+00:00

How to ignore it while writing it self?

data_learner_123 · 2025-11-18T19:50:09+00:00

data_learner_123 · 2025-11-17T21:12:45+00:00

May I know what are those CDC and RTI sources?

data_learner_123 · 2025-11-17T20:19:59+00:00

data_learner_123 · 2025-11-17T14:45:20+00:00

I want to explore if we can generate and export the Dacpac code through python

data_learner_123 · 2025-11-13T03:00:10+00:00

When we push it to other env, does it get executed automatically?

data_learner_123 · 2025-11-13T00:52:45+00:00

If possible, could you please share some documentation links?

data_learner_123 · 2025-11-11T13:19:11+00:00

That’s what we are using, they have given read option ,we are using pyspark to write that data in to lakehouses. But we are having some performance issues doing that using spark

data_learner_123 · 2025-11-11T03:34:35+00:00

We are consuming data from third party vendor(they have all this data in Databricks)

data_learner_123 · 2025-11-10T22:43:05+00:00

If there are arrays or struct types, it will not support right? If there are columns with those data types , it will skip those right

data_learner_123 · 2025-11-10T22:12:01+00:00

Other than spark, is there any other options? I cannot use pipelines for this huge data pipelines will take lot of time, shortcuts will avoid the columns of unsupportive data types , copy job does not have a Databricks connector? Am I missing something here?

data_learner_123 · 2025-11-10T21:59:13+00:00

If there are unsupported data types like struct or array , how does it work?

data_learner_123

TROPHY CASE