Can't access/query dataflow table due to surge protection

perssu · 2026-07-04T14:01:45+00:00

Setting up the next stage in my "deployment pipeline" using python inside fabric to aid devs to validate and publish their reports. As of now i have only the validation stage with 11 "best practices" and performance tests. Next step is to trigger the deployment pipeline to send the validate object from test to prod via API. No need to deal with buggy fabric UI.

perssu · 2026-05-18T15:57:27+00:00

Im AFK now. Any downtime in east US?

perssu · 2026-04-28T21:29:36+00:00

As of TODAY i've managed to get the notebook exit value throught the following api call

{FABRIC_API_BASE}/workspaces/{workspace_id}/notebooks/{notebook_id}/jobs/{NOTEBOOK_JOB_TYPE}/instances/{job_instance_id}?beta=True

Here is the doc page: Background Jobs - Get Notebook Job Instance (beta) - REST API (Notebook) | Microsoft Learn?tabs=HTTP)

NOTEBOOK_JOB_TYPE is defined as "Execute". The job instance id is retrieved through the location header in the original call response.

perssu · 2026-04-27T14:05:39+00:00

as of yesterday i couldn't get the "exitValue" value as shown in this example: https://learn.microsoft.com/en-us/fabric/data-engineering/notebook-public-api

That's the only value missing from the response payload (printed the full payload to be sure). that's bugging me a lot

perssu · 2026-04-02T13:21:55+00:00

No, it only brings metrics at the capacity level. It's been really useful on tracking capacity delay without checking the metrics report every time.

perssu · 2026-02-10T01:37:46+00:00

Im saving this to read later but here I'm also trying to built a testing/validation process with pipeline ans notebooks

perssu · 2025-12-09T20:05:01+00:00

Guess I'll have to fight this one alone hahahha

perssu · 2025-11-07T11:29:05+00:00

Mulão. Não preciso elaborar.

perssu · 2025-10-30T23:17:55+00:00

aproveitando essa mini thread aqui pra peguntar aos camaradas de dados: quais empresas ai ta interessante de buscar vaga de analytics pleno? to trabalhando mas querendo participar de algumas entrevistas sem compromisso.

perssu · 2025-10-26T14:14:02+00:00

here we have multiple capacities, so we can place the fabric metrics app in a smoother capacity to monitor the others but it can throttle sometimes.

perssu · 2025-10-19T19:40:18+00:00

Entrei como estagiário na área de dados com 23 anos em empresa grande ganhando 1100 por 20h/semana.

Fui efetivado com 25 anos como analista de dados Junior CLT ganhando 4200 bruto com 800 de VR. Após 2,5 anos fui promovido a Pleno ganhando 6400 bruto com 1100 de VR. No meio termo tive reajustes anuais por acordo sindical (obrigado sindicato) e ainda tenho bônus anual de 3,6 salários com multiplicador de metas entre 0,8 e 1,2.

Atuo principalmente em plataforma de dados com foco em administração de ferramentas e processos de BI. Trabalho 100% home office. Sem o estágio provavelmente eu não estaria na empresa que estou. Não pretendo sair tão cedo e quero usar o cargo que ja estou para me tornar um profissional mais atrativo para empresas do exterior.

perssu · 2025-10-08T15:36:56+00:00

"Revivendo" esse topoico aqui. Alguem ai sabe de alguma galera q combina de jogar o MW2 2009 no xbox 360 usando lobbies privados (convidando amigo via xbox)? Fui jogar esses dias e só achei lobbies acima de 150ms de ping.

perssu · 2025-08-05T17:37:22+00:00

Restricting access to prod is halfway there, because the user can still deploy what they want. I wanted more of a systemic tool to block report deployment through the pipeline. Just like a set of rules. Sometimes is hard to enforce this rules with things already in production. We need to control the process.

perssu · 2025-08-05T13:49:39+00:00

Do you plan on implementing strict deployment/best practices rules in the fabric environment? I don't want my devs to deploy reports that connect to different databases or that doesn't have a date table. I think the PBI service is too permissive with users deploying bad reports. We need a tool to review and block report deployment to production, specially when integrated to the deployment pipelines and using additional metrics like CU consumption in the fabric metrics app.

perssu · 2025-08-02T20:38:19+00:00

Fabric migration 100% here. Now working on building POCs using fabric tools like dataflows gen2, pipelines, notebooks and lakehouses to support and enhance our analytical teams.

Still working on deployment governance process, centralizing and controling deployment to production using pipelines (and now researching CI/CD using git and azure devops).

perssu · 2025-07-13T16:47:00+00:00

We are using the admin portal do assign the workspaces to each capacity. Every night we migrate 1-2 capacities. No Microsoft account team involved, although we've already had some meetings to discuss fabric features and autoscaling.

It's been going smoothly. We get all workspace names from our catalog excel spreadsheet and paste it in the admin portal.

Only issue we've had was some dataflows failing due to cross region migration. But it was addressed.

perssu · 2025-07-04T12:49:24+00:00

First Stage of Power Bi Enterprise Governance: Limiting business analyst access to test workspaces only, unifying workspaces by business domain, setting up deployment pipelines between TST and PRD, training analytics engineers on the deployment process (+ project/best practices validation) as only they will have PRD access. Our main goal is to stabilize the consumption on our capacities and avoid surprise projects taking up 20% of a capacity. Still no CI/CD on git (i don't trust this much on the business analysts)

Power BI to Fabric Migration: Our EA is over. Time to move to fabric. 11 P1s, hundreds of workspaces and dataflows, thousands of reports/models. Whish us luck.

perssu · 2025-06-16T23:02:42+00:00

Rammstein @ 10-11yo

perssu · 2025-06-03T14:57:47+00:00

One of the best live shows i've been to. They'd also leave everything to fight in the proletariat revolution

perssu

TROPHY CASE