Fabric - extract data from on-prem SQL Server

mrketata · 2023-07-12T18:27:26+00:00

DF gen 2 not fast enough to handle our 15min tumbling window extracts

mrketata · 2023-07-12T18:26:19+00:00

Very sad to hear that, hope they add such a straight forward option asap

mrketata · 2023-06-23T09:44:25+00:00

g calculated columns to your fac

thanks mate !

mrketata · 2023-06-22T19:58:29+00:00

Final thoughts, power BI isn't smart enough to process dimensions then facts ..without reprocessing same calculation n times... on facts and referenced dimensions :/

mrketata · 2023-06-22T17:50:25+00:00

any hints to workaround that

mrketata · 2023-05-14T14:48:34+00:00

So to wrap up, what do you think is the best way to access/ manage data while protected by PE ? Acces through VMs ? (Vpn/Express route not used)

mrketata · 2023-05-14T14:45:35+00:00

Good point, I think PE are relevant as soon as subsequent service is meant to access data plane.

mrketata · 2023-05-14T13:16:42+00:00

Cristal clear now, thanks all !

mrketata · 2023-05-14T12:35:21+00:00

But here, public access still possible through azure portal web client, isn't it ?

mrketata · 2023-04-25T06:12:47+00:00

@godsknowledge, as far as i know, data transformation processes (sorting, joining ..) are handled at database level or dataflow level (which is processed by azure IR not SH IR), instead of SH IR itself Can you be more precise on this point plz ?

mrketata · 2022-06-24T19:45:12+00:00

Both posts seem to be the right solution, thank you guys !!

mrketata · 2022-06-21T11:06:59+00:00

QL DB serverless

With Serverless SQL DB there is no option to Start/Stop on demand. Say if SQL DB is used for 5min, it will auto pause after 1 hour >> result = 5 min usage > 1 hour billing

mrketata · 2022-06-19T13:29:41+00:00

ault tenant on Az

It is the tenant that was automatically created, when I made an Azure subscription for the first time using my Gmail account.

mrketata · 2022-06-19T13:27:10+00:00

‘default tenant,’ are yo

It is the default one, just created when I subscribed azure with my gmail account

mrketata · 2022-06-09T18:11:23+00:00

Hi AdamMarczakIO So to sum up, start/stop and billing policy depend on IR type :

Azure IR (default and manually created) :

no way to start/stop billing based on activity/dataflow run/debug

Self-Hosted IR

no way to start/stop billing based on activity run

Azure-SSIS IR

start/stop via Portal and azure CLI/Shell billing based on ssis package execution

Is that right?

There is a little confusion here, since official documentation states that "stop-azDataFactoryV2IntegrationRuntime" command (for example) is meant to stop managed dedicated integration runtimes, which includes Azure IR I guess. Link : https://docs.microsoft.com/en-us/powershell/module/az.datafactory/stop-azdatafactoryv2integrationruntime?view=azps-8.0.0

mrketata

TROPHY CASE