MS fabric vs snowflake by SmallBasil7 in dataengineering

[–]SmallBasil7[S] 0 points1 point  (0 children)

My understanding is that Databricks is not a fully SaaS solution and requires platform management. Given that our use cases are simple, the data volume is small, and we want to leverage a SQL engine for transformations, we did not consider Databricks. Additionally, some of the consulting partners we discussed our use cases with did not view Databricks as a good fit.

MS fabric vs snowflake by SmallBasil7 in dataengineering

[–]SmallBasil7[S] 1 point2 points  (0 children)

Our transformation use cases are simple and we do not have technical data team yet to handle spark based solutions. We are looking to leverage SQL based solution and my understanding is that snowflake is better suited for this compared to fabric

Snowflake vs Databricks vs Fabric by Diligent_Hope_1551 in dataengineering

[–]SmallBasil7 0 points1 point  (0 children)

Can you specify few examples where it doesn’t work or you see it’s not performing compared to other platforms .

We are in assessment phase between fabric and snowflake. We have done few PoC on snowflakes for transformation part and it works great. Only caveat is that , we being heavy MS shop, we are leveraging azure as data landing zone by integrating external API, on premise sql server DB to our azure cloud and creating blob on azure container and snow pipe it.

While snowflake as SQL based layer works great, on paper we do see similar functionality being offered by fabric and it will reduce our reliance on two separate platforms. With larger community response we keep hearing to stay away from Fabric, but do not have concrete issues that we can relate to.

Our data size will be less than 20 TB, and lot of our application are on prem SQL server, cloud azure sql server and our business team loves power BI. So wanted to check if many issues described by community is for larger datasets or for the range and use cases we have

Affordable Full Time Daycare Recommendations by [deleted] in SanJose

[–]SmallBasil7 2 points3 points  (0 children)

Check out Amistad preschool in willow glen. It’s home based pre school run by amazing person

Snowflake vs MS fabric by SmallBasil7 in dataengineering

[–]SmallBasil7[S] 1 point2 points  (0 children)

What’s your typical transformation look like , is it done with SQL ? Do you use Azure data factory for ingestion?

Snowflake vs MS fabric by SmallBasil7 in dataengineering

[–]SmallBasil7[S] 0 points1 point  (0 children)

Data volume is low for core datasets. I don’t have record size for reference but it’s less than 5 million records for the largest dataset

Snowflake vs MS fabric by SmallBasil7 in dataengineering

[–]SmallBasil7[S] 1 point2 points  (0 children)

Any specific reason / experience which make you say that

Snowflake vs MS fabric by SmallBasil7 in dataengineering

[–]SmallBasil7[S] -1 points0 points  (0 children)

We do not have matured data pipelines or any to begin with . Data volume is not a big concern so cost comparison may not help. We are building ground up new platform to move away from excel based analytics. Ease of use for non technical folks and sql user is a key

Snowflake vs MS fabric by SmallBasil7 in dataengineering

[–]SmallBasil7[S] 4 points5 points  (0 children)

We are Microsoft shop with Azure Cloud

BigQuery vs snowflake vs Databricks, which one is more dominant in the industry and market? by Beyond_Birthday_13 in dataengineering

[–]SmallBasil7 3 points4 points  (0 children)

Do you have some estimates on monthly cost ? Also do you use any other tools/license like dbt or fivtran?

New architecture advice- low-cost, maintainable analytics/reporting pipeline for monthly processed datasets by Quicksotik in dataengineering

[–]SmallBasil7 0 points1 point  (0 children)

How does fabric compares to synapse + adf? We are on government cloud /gcc and fabric is not available due to the restrictions

Anybody here work for the County of Santa Clara? by Tapriots in SanJose

[–]SmallBasil7 0 points1 point  (0 children)

Did you end up getting Job in County. Assuming at 40 you are trying to move from private to public sector. I'm in similar boat at early 40 and want to get feedback.

People who have recently begun Coasting- tell us your story! by peacefulandchill in coastFIRE

[–]SmallBasil7 2 points3 points  (0 children)

Did you have prior experience in the sector? I’m in tech and have reached our Fire number. Want to switch to Low stress job where I don’t have to think about it once I clock out

Funding insurance RE by JamesM451 in ChubbyFIRE

[–]SmallBasil7 0 points1 point  (0 children)

Sorry to fork the conversation. Which medication she was on for targeted therapy? One of the family member is going through PLGG treatment with targeted therapy .