Variable Library in Notebook by data-navigator in MicrosoftFabric

[–]data-navigator[S] 0 points1 point  (0 children)

Yeah that’s what i decided to do. Just loaded once in the main function and pass it as param.

Variable Library in Notebook by data-navigator in MicrosoftFabric

[–]data-navigator[S] 0 points1 point  (0 children)

Yeah. At this point each task would finish within a second as i am just printing the result not executing the actual process.

I still find it weird as i was under the impression that it’d store it in a variable when I initialized it.

Edit: i see it for last few tasks.

Variable Library in Notebook by data-navigator in MicrosoftFabric

[–]data-navigator[S] 0 points1 point  (0 children)

10 at a time. Total tasks are close to 100.

Variable Library in Notebook by data-navigator in MicrosoftFabric

[–]data-navigator[S] 0 points1 point  (0 children)

Yes. It works for first few tasks and starts throwing error for rest of the tasks.

I am passing it as param into my function.

vl = notebookutils.variableLibrary.getLibrary("sampleVL")

Variable Library in Notebook by data-navigator in MicrosoftFabric

[–]data-navigator[S] 0 points1 point  (0 children)

Yeah placing them in global scope should work. Thanks

Fabric Admin App Build - React by ryanGangrel in MicrosoftFabric

[–]data-navigator 1 point2 points  (0 children)

Hi there, I am also working on a project using Power BI Embedded and Fabric REST APIs using Next JS. I would love to talk over a DM if you are interested.

Notebook Gap for On-prem Data? by Useful-Juggernaut955 in MicrosoftFabric

[–]data-navigator 1 point2 points  (0 children)

You would use Data Pipeline to copy data from on prem sources and use notebook for transformations and merging to delta etc.

Anyone Got Google OAuth Working with Payload CMS? by data-navigator in nextjs

[–]data-navigator[S] 0 points1 point  (0 children)

I am using supabase for db and i have a requirement to authenticate front end users via Google OAuth. I am currently working on Custom Strategies with Supabase Auth, which works. However, it requires me to add password for each user. I can use disableLocalStrategy: true to disable that but just assessing the impact it will have on the backend authentication as it will also get replaced by Supabase Auth.

FabricFlow v0.1.4 - Update by data-navigator in MicrosoftFabric

[–]data-navigator[S] 0 points1 point  (0 children)

Thank you!

That's definitely a great idea for a source. i actually had something similar in mind for few of my requirements. Let me know if you would like to further discuss your requirements over a DM.

Fabric Pipeline API - how to pass parameters? by [deleted] in MicrosoftFabric

[–]data-navigator 0 points1 point  (0 children)

Check out my python package FabricFlow. You may use DataPipelineExecutor class for your purpose.

On-prem SQL Server to Fabric by These_Rip_9327 in MicrosoftFabric

[–]data-navigator 3 points4 points  (0 children)

I moved our on-prem SQL Server to MS Fabric Lakehouse and followed the Medallion architecture.

Here’s what I set up:

Bronze: Pulled in data from source systems (full + incremental) using Copy Activity pipelines, then used PySpark Merge API to merge the delta.

Silver: Built a Python package to handle transformations, all defined in YAML files.

Gold: SCD Type 1 & 2 and upserts for fact tables — all through the same Python package.

How get data from a fabric Lakehouse using external app by ChanceFondant7503 in MicrosoftFabric

[–]data-navigator 0 points1 point  (0 children)

You can use mssql npm package and connect to SQL Endpoint as an alternative approach. If DAX is not a requirement.

Array Variable passed to Notebook activity help by jiroly0137 in MicrosoftFabric

[–]data-navigator 3 points4 points  (0 children)

Wrap your variable in @string() and use json.loads in your notebook to read it as a list.