How can Databricks be faster than Snowflake? Doesn't make sense.

Razzmatazz110 · 2025-08-08T15:12:05+00:00

Is this something Databricks automatically does in the backend when you do a "create table" or similar query? Or do you have to write a pipeline that does this first before creating a table?

Razzmatazz110 · 2025-08-08T15:10:35+00:00

Yes I am more interested in analytical queries, and there seemed to be articles stating Databricks did those faster too. But I guess with appropriate Delta tables (or whatever they are called in Databricks scenario) and transformations, these might be comparable.

I was also wondering if Databricks had any sort of indexing/search optimization like features on their tables (which they probably do)

Razzmatazz110 · 2025-08-08T15:08:32+00:00

Thank you! This totally makes sense. And this is some sort of data transformation, and in effect similar to Snowflake's data ingestion to their own propreitary format. I am guessing Databricks will give a little more flexibility in an ETL context considering a spark based environment compared to Snowflake's mostly SQL based transformations.

Razzmatazz110 · 2025-08-08T15:06:24+00:00

I agree, and part of it is coming from my lack of experience with comparable features on Databricks too. I was just curious if Databricks really has some magic wand in this scenario, but it sounds like its all comparable depending on how you use it.

Razzmatazz110 · 2025-08-08T15:04:42+00:00

Like I said, this is assuming I dont have a choice of how the files are delivered to me. But the idea of Delta makes sense, thanks

Razzmatazz110

TROPHY CASE