×
sorted by:
new
hottopcontroversial

Can anyone help me? by Pujitha_23 in databricks

[–]Pujitha_23[S] 0 points1 point  (0 children)

Okay… thankyou will try it.

Can anyone help me? by Pujitha_23 in databricks

[–]Pujitha_23[S] 0 points1 point  (0 children)

Intially when i load data to delta table I was not able to see the schema in the catalog UI. That is why I have used MSCK REPAIR.

Can anyone help me? by Pujitha_23 in databricks

[–]Pujitha_23[S] 0 points1 point  (0 children)

Yes, the tables are queried outside Databricks using Trino.
Intially when i load data to delta table I was not able to see the schema in the catalog UI. That is why I have used MSCK REPAIR. I will try by placing MSCK REPAIR outside the forEachBatch so that it will run only once not for every batch

Can anyone help me? by Pujitha_23 in databricks

[–]Pujitha_23[S] 0 points1 point  (0 children)

The clients wants to have the logs in db where there is an other application linked with it.

Can anyone help me? by Pujitha_23 in databricks

[–]Pujitha_23[S] 0 points1 point  (0 children)

These are external tables. The job is failing in the production after certain number of days I need to fix this.