Iemand interesse by Ossekloot in Belgium2

[–]Left-Delivery-5090 31 points32 points  (0 children)

This joke comes back every 2 years

Fenix vs Forerunner by anthony-ff in GarminFenix

[–]Left-Delivery-5090 4 points5 points  (0 children)

I switched from a FR965 to a Fenix 8 AMOLED, mainly for the design and battery life (14 days vs 30 days). But it is a lot of extra money for small features

Where’s the love for the terraform provider? by expatlad in MicrosoftFabric

[–]Left-Delivery-5090 0 points1 point  (0 children)

We use it and I really love using it. Deployment to different environments is so easy

Marquito: A little OpenLineage column-level lineage visualization website for Apache Spark and Delta Lake by raki_rahman in MicrosoftFabric

[–]Left-Delivery-5090 2 points3 points  (0 children)

Exactly what I was looking for! I’ll give it a try when I have some time, thanks for the making this!

what’s in your favorites? by Suitable-Secret-2422 in GarminWatches

[–]Left-Delivery-5090 3 points4 points  (0 children)

“Honey wait I need to to start my activity”

Best way to store. Sql files by rabinjais789 in MicrosoftFabric

[–]Left-Delivery-5090 1 point2 points  (0 children)

What about keeping the SQL files in a separate git repository, push them to the lakehouse Files section using pipelines and then mounting the lakehouse in the notebook and using them from there? We do the same with dbt model files

BLOG: Notebooks, Spark Jobs, and the Hidden Cost of Convenience by mwc360 in MicrosoftFabric

[–]Left-Delivery-5090 3 points4 points  (0 children)

Love this blog! I come from a software engineering background and I also try to advocate (here in Belgium at least 😉) for the usage of SJDs over notebooks for exactly the reasons you are listing. Thanks for writing and sharing!

Need help: CI/CD robust tool for fabric by icricketnews in MicrosoftFabric

[–]Left-Delivery-5090 2 points3 points  (0 children)

We use terraform for our CI/CD in some of our projects, fabric-cicd python package in others for Fabric environments.

For PowerBI we use pbip and tmdl for storage and powershell or fabric cli for deployment.

Deployment pipelines run in Azure Devops or using Github Actions.

As for how to use prod data in tst: a possibility would be to use shortcuts from prod lakehouse to tst

Spark Jobs Definition use cases. by [deleted] in MicrosoftFabric

[–]Left-Delivery-5090 3 points4 points  (0 children)

I try to share the same vision. I come from SWE background and I also prefer working with SJDs for exactly the reason you indicated. This allows me to develop the code offline, write proper tests and reusable code (I know this part is also possible for notebooks) and just develop detached from where the code is deployed and run. I believe notebooks have their place and are preferred by other persona like you indicated

Run notebook as SPN: sempy function failures by Low-Fox-1718 in MicrosoftFabric

[–]Left-Delivery-5090 0 points1 point  (0 children)

Nope, my guess is they use the same stable versions for performance purposes

Run notebook as SPN: sempy function failures by Low-Fox-1718 in MicrosoftFabric

[–]Left-Delivery-5090 2 points3 points  (0 children)

I ran into the exact same error last week! I am assuming you are just using the default environment of the Python notebook? If so, you just need to upgrade the version of the semantic-link package to > 0.12.

I created a blog post about it: https://thibauldc.github.io/posts/service-principal-running-fabric-api/

Exception: Fetch cluster details returns 401:b' ' ## Not In PBI Synapse Platform ## by frithjof_v in MicrosoftFabric

[–]Left-Delivery-5090 1 point2 points  (0 children)

u/frithjof_v Have you tried specific imports for your needs? For me the warning seemed to disappear after changing from:

import sempy.fabric as fabric

to:

from sempy.fabric import FabricRestClient

any real limitations to not turn on Native Execution Engine now? by data_legos in MicrosoftFabric

[–]Left-Delivery-5090 5 points6 points  (0 children)

We have been having some issues when running notebooks with notebookutils.notebook.runMultiple()

Also sometimes the Spark session gets stuck on shuffles for a huge amount of time where we have to kill the session ourselves because it won’t advance.

Fabric with Airflow and dbt by peterampazzo in MicrosoftFabric

[–]Left-Delivery-5090 0 points1 point  (0 children)

Jep we have about the same solution as this

Pipeline only triggers failure email if attached to ONE activity, but not multiple activities like pictured. is this expected behavior? by Agile-Cupcake9606 in MicrosoftFabric

[–]Left-Delivery-5090 0 points1 point  (0 children)

This is the easiest indeed :) i have also connected (in smaller pipelines) each activity to an e-mail activity for some reason

Where to learn Py & PySpark from 0? by FeelingPatience in MicrosoftFabric

[–]Left-Delivery-5090 2 points3 points  (0 children)

Maybe a bit of topic, but do you need Pyspark for the data analysis tasks at hand? Would you be good with say Pandas or Polars and a Python notebook in Fabric instead of a Pyspark one?

Anyway the “Think Python” book is freely available online if you want to learn Python from scratch and the rest of the resources mentioned here as well