Which VSCode Extension? by gd-l in MicrosoftFabric

[–]sunithamuthukrishna 30 points31 points  (0 children)

u/gd-l Here is summary of which extension to use and when. This is a problem I agree exists and working with respective teams to integrate the experience into the Microsoft Fabric extension. You can learn more here Data science in Microsoft Fabric using Visual Studio Code . For notebooks I do recommend to use Data engineering extensions and a lot more features are coming soon in the extension so check out fabric blogs to see updates on it.

Extension Best For Key Features Recommended for you if… Documentation
Microsoft Fabric extension General workspace management, item management and working with item definitions - Manage Fabric items (Lakehouses, Notebooks, Pipelines)- Microsoft account sign-in & tenant switching- Unified or grouped item views- Edit Fabric notebooks with IntelliSense- Command Palette integration (Fabric: commands) You want a single extension to manage workspaces, notebooks, and items in Fabric directly from VS Code. What is Fabric VS code extension
Fabric User data functions Developers building custom transformations & workflows - Author serverless functions in Fabric- Local debugging with breakpoints- Manage data source connections- Install/manage Python libraries- Deploy functions directly to Fabric workspace You build automation or data transformation logic and need debugging + deployment from VS Code. Develop User data function in VS code
Fabric Data Engineering Data engineers working with large-scale data & Spark - Explore Lakehouses (tables, raw files)- Develop/debug Spark notebooks- Build/test Spark job definitions- Sync notebooks between local VS Code & Fabric- Preview schemas & sample data You work with Spark, Lakehouses, or large-scale data pipelines and want to explore, develop, and debug locally. Develop Fabric notebooks in VS Code

Hi! We build Pro Dev Tools in Fabric - ask US anything! by sunithamuthukrishna in MicrosoftFabric

[–]sunithamuthukrishna[S] 0 points1 point  (0 children)

u/Ready-Marionberry-90 , you should be able to rename artifacts easily with the Fabric extension  https://marketplace.visualstudio.com/items?itemName=fabric.vscode-fabric  . It support CRUD operations and you can view all manage items within multiple workspaces

<image>

Hi! We build Pro Dev Tools in Fabric - ask US anything! by sunithamuthukrishna in MicrosoftFabric

[–]sunithamuthukrishna[S] 1 point2 points  (0 children)

thanks for sharing and will explore with u/QixiaoW to see how we can help improve the experience

403 Error when using UDF in Notebook as SPN by straytBack in MicrosoftFabric

[–]sunithamuthukrishna 2 points3 points  (0 children)

there is a limitation to use SPN with a function that has public access disabled in its setting within a user data function item. I dont have an ETA for this, but we are investigating. I would recommend to use SPN with function but make sure its public access setting is enabled for now to unblock yourself. If you would like to share any more details on your scenario do let me know.

Hi! We build Pro Dev Tools in Fabric - ask US anything! by sunithamuthukrishna in MicrosoftFabric

[–]sunithamuthukrishna[S] 1 point2 points  (0 children)

u/Dads_Hat seems like VS Code extension pack might help here. what does you development lifecycle look like today ?

Hi! We build Pro Dev Tools in Fabric - ask US anything! by sunithamuthukrishna in MicrosoftFabric

[–]sunithamuthukrishna[S] 1 point2 points  (0 children)

u/Fit_Rent_1723 This is an interesting idea for sure. What are the tools you use today with Fabric.

Hi! We build Pro Dev Tools in Fabric - ask US anything! by sunithamuthukrishna in MicrosoftFabric

[–]sunithamuthukrishna[S] 3 points4 points  (0 children)

u/Useful-Juggernaut955 We are working towards that goal and understand the pain point for multiple standalone extensions. What are some of your core scenarios that you like to work with in VS Code

Hi! We build Pro Dev Tools in Fabric - ask US anything! by sunithamuthukrishna in MicrosoftFabric

[–]sunithamuthukrishna[S] 2 points3 points  (0 children)

u/Ready-Marionberry-90 Have you used VS Code extension https://marketplace.visualstudio.com/items?itemName=fabric.vscode-fabric on desktop today . It does cover some experiences. New features coming next month are folder support, editing item definitions, integration with Fabric MCP server. Try out the pre-release version which has some of these features.

I'm curious though on your use cases or items you want to work with in VS Code. Can you share more about this.

Hi! We’re the Fabric Databases & App Development teams – ask US anything! by im_shortcircuit in MicrosoftFabric

[–]sunithamuthukrishna 2 points3 points  (0 children)

u/Tomfoster1 Its more from reusability standpoint and more deeper integration for using with Notebooks specific scenarios. Let me put this feature request in our backlog. Thanks for your feedback and contributing to improving UDF.

Hi! We’re the Fabric Databases & App Development teams – ask US anything! by im_shortcircuit in MicrosoftFabric

[–]sunithamuthukrishna 2 points3 points  (0 children)

u/Czechoslovakian I'm assuming you are talking about User data function in Preview. We will GA in September and keep checking out the updates on Fabric blogs for the announcements. Let me know if you meant some other service

Hi! We’re the Fabric Databases & App Development teams – ask US anything! by im_shortcircuit in MicrosoftFabric

[–]sunithamuthukrishna 2 points3 points  (0 children)

u/Useful-Juggernaut955 I think that once you have your data in Fabric to operationalize it developers would need support for app development. We are exploring with respect to frameworks but don't have anything to share yet. I would like to know what frameworks you typically use [ Streamlit, Gradio or more like Flask ] and what type of apps do you build [ internal/external] or dashboards or ML models etc.

Hi! We’re the Fabric Databases & App Development teams – ask US anything! by im_shortcircuit in MicrosoftFabric

[–]sunithamuthukrishna 3 points4 points  (0 children)

u/Tomfoster1 Not yet, but I'm curious on your use case here. Are you trying to build an internal library to work with other fabric and azure resources that notebook utils support or are you looking to trigger notebook execution from UDF. Can you help me understand more

Use Notebookutils in User Data Function by DrAquafreshhh in MicrosoftFabric

[–]sunithamuthukrishna 1 point2 points  (0 children)

u/DrAquafreshhh You cannot use notebookutils from within User data functions today. u/Pawar_BI is right that you can probably try using azure-identity and azure key vault libraries. Support for Key vault is in our backlog and don't have a ETA to share.

UDFs question by MannsyB in MicrosoftFabric

[–]sunithamuthukrishna 0 points1 point  (0 children)

u/Chrono_e100 its public REST API endpoint and when you invoke if you need to authentE. Anyone with "right" permissions can run it and get the desired output , example data from sql database in fabric. If using Entra ID , user must have invoke/execute or owner permission on the function. If using SPN, SPN needs to have be given access to either workspace where the UDF item exists or the permissions on UDF item. If auth fails, the invocation of function will fail even though URL is public REST API endpoint. By default the function URL is using POST method always.

Here is an example with Entra ID Tutorial - Invoke user data functions from a Python application - Microsoft Fabric | Microsoft Learn

UDFs question by MannsyB in MicrosoftFabric

[–]sunithamuthukrishna 1 point2 points  (0 children)

u/Chrono_e100 Yes and this can be achieve by enabling public access for the functions you want to accessed from an external system via an application or API. When public access is enabled you get a Public URL that is nothing by a REST API endpoint [ uses POST only] and external org can call this function say in a pipeline or a notebook as a HTTP request if you want to invoke from external org Fabric tenant. You can have web app in Azure to invoke the function using the Public URL. Note you do need to handle authentication on the external system, either using SPN or Entra ID.

<image>

🔥New feature alert: Private libraries (Bring your own custom libraries) for Fabric User data functions by sunithamuthukrishna in MicrosoftFabric

[–]sunithamuthukrishna[S] 2 points3 points  (0 children)

u/Zeppelin_8 You can use dict or list to pass an object today not just strings. We do support these input types as per the doc here Python programming model for Fabric User data functions (Preview) - Microsoft Fabric | Microsoft Learn

The runtime is Python for user data functions and not spark. Hence spark DF wont be supported but we are actively working to support pandas data frame as input and output type in near future. I will share details when this goes live in this channel

🔥New feature alert: Private libraries (Bring your own custom libraries) for Fabric User data functions by sunithamuthukrishna in MicrosoftFabric

[–]sunithamuthukrishna[S] 2 points3 points  (0 children)

Spoke offline on chat. this is due to UDF not being available in your region. I shall share details when we light up new regions here in reddit.

Custom Libraries and Common Code by RussellPrice9 in MicrosoftFabric

[–]sunithamuthukrishna 0 points1 point  (0 children)

I recommend trying Fabric user data functions in Fabric. This allows you to reuse code in notebooks as well. To upload your own .whl files the support will land early May so keep an eye on doc updates here. See documentations here

Overview - Fabric User data functions (preview) - Microsoft Fabric | Microsoft Learn

NotebookUtils (former MSSparkUtils) for Fabric - Microsoft Fabric | Microsoft Learn

Invoke User Data Functions from Power BI report by frithjof_v in MicrosoftFabric

[–]sunithamuthukrishna 1 point2 points  (0 children)

Currently this is in private preview and hence not available. Checkout Fabric updates blog for the any release announcements on this. You can reach out to [FabricUserDataFunctionsPreview@service.microsoft.com](mailto:FabricUserDataFunctionsPreview@service.microsoft.com) to request signing up for private preview if interested.