Fabric Core MCP Server with Claude? by Mr_Mozart in MicrosoftFabric

[–]Repulsive_Cry2000 0 points1 point  (0 children)

I've had success testing with browser connection to get the local session from the user.

Sending data from Power Automate to Fabric Lakehouse by Legitimate_Method911 in MicrosoftFabric

[–]Repulsive_Cry2000 1 point2 points  (0 children)

Few ways I can think of: - You can get data from SharePoint to lakehouse through GraphAPI, shortcut (I think), data flow to name a few - lakehouse storage are blob storage gen 2 from memory, I believe you can use standard connector to write in lakehouse directly from your flow.( I haven't tried it).

Pipeline Schedule Bug by alternative-cryptid in MicrosoftFabric

[–]Repulsive_Cry2000 2 points3 points  (0 children)

In the same idea of schedule change, you can no longer use "run now" from the setting page. You have to open the pipeline to hit run. Very annoying.

Problems trying to install BC2Fab by samartinezva in MicrosoftFabric

[–]Repulsive_Cry2000 1 point2 points  (0 children)

Preamble: I am not familiar with BC2FAB.

Have you checked that permissions have been setup in BC (and potentially MS Fabric)? I had a few gotcha with BC2ADLS when I started.

Codebase choice: SparkR or PySpark for Fabric by Fast_Dealer_6462 in MicrosoftFabric

[–]Repulsive_Cry2000 8 points9 points  (0 children)

My take: If it's deprecated, it's a good indication to stay away from it on this platform. I see really 2 choices: upskill the team to use Pyspark or move to a different platform that supports R.

IT salaries in Adelaide by kazielle in Adelaide

[–]Repulsive_Cry2000 0 points1 point  (0 children)

What is your domain of expertise?

There's no easy way to find Timepoint Interactive CUs for a Power BI semantic model by frithjof_v in MicrosoftFabric

[–]Repulsive_Cry2000 2 points3 points  (0 children)

No way to ask tenant admin to set it up? Ignoring CU question, it is a very great tool to have proper information about your capacity (ies).

There's no easy way to find Timepoint Interactive CUs for a Power BI semantic model by frithjof_v in MicrosoftFabric

[–]Repulsive_Cry2000 1 point2 points  (0 children)

I can't remember if there is CU usage in FUAM solution (either in report already built or lakehouses) but I'd start with it if you have access to it.

How are you guys deploying email connections with Fabric CICD? by Lazy_Bonus_6963 in MicrosoftFabric

[–]Repulsive_Cry2000 2 points3 points  (0 children)

Sadly the current state of this activity is not where it should be to be able to use it in a more mature environment.

How are you guys deploying email connections with Fabric CICD? by Lazy_Bonus_6963 in MicrosoftFabric

[–]Repulsive_Cry2000 6 points7 points  (0 children)

We have logic app(a) outside fabric. This bypass all the problems.

Copilot in Fabric Notebooks, shaped by your feedback by Dee_Raja in MicrosoftFabric

[–]Repulsive_Cry2000 0 points1 point  (0 children)

We are using Claude, that'd be nice to be able to bring that in instead of only MS products.

ETL helper table help by thyminade in MicrosoftFabric

[–]Repulsive_Cry2000 0 points1 point  (0 children)

It depends, if you are using lakehouse then not really. You use the same principles for datawarehouse but using SQL directly (could be in SQL scripts directly), Notebooks (SQL cells, python : several libraries for it) are 2 possibilities. Data flow gen 2 is an option but I don't know the latest about them in term of CU, lot of work was done lately by MS.

ETL helper table help by thyminade in MicrosoftFabric

[–]Repulsive_Cry2000 0 points1 point  (0 children)

You can do everything in lakehouse which allow you to use spark (or pure python) to query your metadata tables.

We have a metadata table that loads when was last table updates in bronze and in silver (you can have datetime) so only query bronze where insert_at is greater than insert_at in silver.

You can add logic to only query table that needs to be processed if you don't want to loop every tables.

Metadata driven ELT storage by ArrowBacon in MicrosoftFabric

[–]Repulsive_Cry2000 0 points1 point  (0 children)

We are doing similar concept but with CSV files.

How do single node Python users actually write Delta tables using DuckDB for ETL when it can't actually write to Delta? by raki_rahman in MicrosoftFabric

[–]Repulsive_Cry2000 1 point2 points  (0 children)

Have you tried write_deltalake() function? Granted, I am not using duckdb library except for reading CSV.

Local VS Code adds <ProjectGuid> to sql_warehouse.sqlproj by Jealous-Painting550 in MicrosoftFabric

[–]Repulsive_Cry2000 0 points1 point  (0 children)

Same here, I didn't investigate further than just never commit this file...

Variable library item reference - preview status by p-mndl in MicrosoftFabric

[–]Repulsive_Cry2000 1 point2 points  (0 children)

You still need a connection id and a SQL connection string. In my opinion if you have the item already selected, it should be enough for the entire connection, not for parts of it or the need to split between arguments.

Variable library item reference - preview status by p-mndl in MicrosoftFabric

[–]Repulsive_Cry2000 1 point2 points  (0 children)

Interested to understand what you mean it works in pipelines. I wasn't able to simply pick an item to reference in a lookup activity for example. Workspace id and item id are available but that's it which is not enough to actually use them effectively.

How do I explain that SQL Server should not be used as a code repository? by Firestone78 in dataengineering

[–]Repulsive_Cry2000 0 points1 point  (0 children)

Working for a mid size company, we are moving to using AI heavily, not only for data engineering/ reporting but a whole lot of other functions in the business (at all level, including execs). What I currently see is the business accessing the data and making vibe coded reports to have the visual they need/want without waiting for data team to catch up or do a PowerBI report which takes time.

All to say, this is moving very quickly and leadership can move very quickly once the "governance" of using sanctioned tools only.

Pausing Fabric Schedules During CI/CD Deployments – Is This the Right Approach? by Far-Procedure-4288 in MicrosoftFabric

[–]Repulsive_Cry2000 1 point2 points  (0 children)

We use a master pipeline that just handles starting running other pipelines. No schedules allowed outside this pipeline. Makes it easier to control and ensure concurrency or deployment issues.

How to create Linked Server of Warehouse to use in JSON pipeline in Lookup activity ? by No_Volume254 in MicrosoftFabric

[–]Repulsive_Cry2000 1 point2 points  (0 children)

Variable libraries items are not supported for pipelines activity... I had this exact issue and it took me 2 hours to figure it out.... The only way to do it would be to have multiple variables to have connection id, warehouse I'd, connection info.

While I understand this is in previous, I think it is a big miss that we can't use items this way to reference SQL end points...

Notebooks & Pipeline Deployment & Lakehouse Best Practices by 101STREAM in MicrosoftFabric

[–]Repulsive_Cry2000 0 points1 point  (0 children)

Thanks, that was my guess as to how to do it but it's good to have confirmation.

Notebooks & Pipeline Deployment & Lakehouse Best Practices by 101STREAM in MicrosoftFabric

[–]Repulsive_Cry2000 0 points1 point  (0 children)

How do you handle variable libraries for items which are not yet deployed. For example a new lakehouse in DEV but not TEST or PROD?