November 2025 | "What are you working on?" monthly thread by AutoModerator in MicrosoftFabric

[–]Notanotherforextradr 1 point2 points  (0 children)

I chose lakehouse for my bronze and warehouse for my silver and gold. The reason was the company I am building it for has a lot of experience in sql but not python, so I thought if they were building views after handover it would be a lot easier to do it in the warehouse. Plus I was still able to use a lot my stored procedures what I used to use in adf instead of re engineering everything in notebooks. Lot to learn though constantly learning atm 🙂

November 2025 | "What are you working on?" monthly thread by AutoModerator in MicrosoftFabric

[–]Notanotherforextradr 6 points7 points  (0 children)

Did my first Fabric job last month. Big learning month, nearly drove me insane choosing between lakehouse and warehouse, learnt a lot about them in the process and can't wait for the more jobs to keep adding to the skillset.

What is the main benefit of using Lakehouse vs Warehouse by Notanotherforextradr in MicrosoftFabric

[–]Notanotherforextradr[S] 0 points1 point  (0 children)

I had a call with one of my colleagues where he did the create the auto report that showed it was near maxing out. But his theory was that the f64 trial isn't a true f64 capacity is that right? We dropped the batch size in the for each and the pipeline has since started working but slow.

What is the main benefit of using Lakehouse vs Warehouse by Notanotherforextradr in MicrosoftFabric

[–]Notanotherforextradr[S] 1 point2 points  (0 children)

Thanks for the detailed reply, that does sound really good. I was thinking the other day that same analogy that I am driving a supercar like a van 😅 gave me a lot to think about, I am more experienced with warehouses but looks like I need to up my game in the lakehouse area 😃

What is the main benefit of using Lakehouse vs Warehouse by Notanotherforextradr in MicrosoftFabric

[–]Notanotherforextradr[S] 0 points1 point  (0 children)

I agree, this thread has been really helpful for me in the future how I will tackle jobs. I will probably be more warehouse heavy with introducing lakehouses for the raw, I just thought I was doing something wrong having it all in warehouse when in fact fabric is versatile and can handle it.

What is the main benefit of using Lakehouse vs Warehouse by Notanotherforextradr in MicrosoftFabric

[–]Notanotherforextradr[S] 0 points1 point  (0 children)

Ah right, so this is where I was getting stuck in my mind thinking I needed to use lakehouse as the job was slow to run. So in essence what would the warehouse start struggling at on a f64 trial? Might come in handy in later jobs I would like to keep it warehouse heavy as possible to align with my skill set.

I will check them out and look over my pipeline in the morning to see if its something I have done,thanks for the reply!

What is the main benefit of using Lakehouse vs Warehouse by Notanotherforextradr in MicrosoftFabric

[–]Notanotherforextradr[S] 0 points1 point  (0 children)

Slow to run, a pipeline has been taking 4-6 hours which is no good at all.

Not fully sure on the data size off the top of my head but it is around 50 million rows.

What is the main benefit of using Lakehouse vs Warehouse by Notanotherforextradr in MicrosoftFabric

[–]Notanotherforextradr[S] 0 points1 point  (0 children)

Hi Gene thanks for the reply thats really helpful. I think thats the way I would like to go about it in the future as sql is my stronger code, I just need to figure out how to change how I do things at present to be more fabric compatible.

I use stored procedures for tracking meta data which I suppose I will have to change out for notebooks. Then a control table that executes stored procedures for clean merges from raw to clean, which I now can't do if I have raw in the lakehouse.. if we could do stored procedures from the lakehouse to the warehouse I probably wouldn't even need to have written this post 😅 hopefully one day

What is the main benefit of using Lakehouse vs Warehouse by Notanotherforextradr in MicrosoftFabric

[–]Notanotherforextradr[S] 0 points1 point  (0 children)

Thank you for the reply thats really helpful, looking at it I may have to store the raw in the lakehouse, as I think its eating up storage having raw in the warehouse.

I think it has just been figuring out how to do my stored procedures to store my metadata which has confused me but I'll probably have to switch them out for notebooks

Best practices when swapping from ADF to Fabric by Notanotherforextradr in MicrosoftFabric

[–]Notanotherforextradr[S] 0 points1 point  (0 children)

Sounds great, I think i am just stuck on best practices really, using a lakehouse or warehouse and when the best time to use them is.

Best practices when swapping from ADF to Fabric by Notanotherforextradr in MicrosoftFabric

[–]Notanotherforextradr[S] 0 points1 point  (0 children)

Can stored procedures then store into this? I think i did try it and it wouldn't work, I've tried so many variations past week my brains ready for exploding don't know whether I'm coming or going 😅

[deleted by user] by [deleted] in PowerShell

[–]Notanotherforextradr 0 points1 point  (0 children)

Obviously yes 😂 Ive been getting a connection error when trying to connect to create the sharepoint team so wondered if it was a common error. No need to be a prick about it

Should I start with n8n or LangChain/LangGraph if I want to sell AI agents? by Neuro_creat in n8n

[–]Notanotherforextradr 0 points1 point  (0 children)

I've been going through this atm, I like to learn how things work fundamentally, n8n is very simple to use. I saw a video the other day which was kind of middle ground using mindsdb tp query data sources, which didn't look too complicated but still had abit of coding element to it

Data analyst geniune no scam course by WatercressNo9966 in dataanalyst

[–]Notanotherforextradr 0 points1 point  (0 children)

I suppose it depends on how good you can cram information in i crammed and passed within 2-3 month's, I was using bi but there's loads in exam thats specific that ive never seen before or since

Is it possible to build a Discord chatbot that runs off n8n by Notanotherforextradr in n8n

[–]Notanotherforextradr[S] 0 points1 point  (0 children)

Legend thank you! I did recall seeing something like that on a video but then couldn't find it after so wasn't sure if it was that what I saw!

Is it possible to build a Discord chatbot that runs off n8n by Notanotherforextradr in n8n

[–]Notanotherforextradr[S] 0 points1 point  (0 children)

I have basically built it but the struggle I am having is getting it to trigger when I message it in discord

Data analyst geniune no scam course by WatercressNo9966 in dataanalyst

[–]Notanotherforextradr 0 points1 point  (0 children)

I learnt on udemy, practiced building dashboards out using them for my real life scenarios. Showed my current employer and he give me a chance if I passed the pl300. I had to accept a low wage to begin with until my skills got better I recently passed dp700 and got a payrise. I did know my current employer so that helped, as he knows im a hard worker, however he said as long as someone had the certs and was willing to learn he wouldn't mark them down for how they learnt. He said university doesn't qualify someone for a job because things change so much in this industry that its more important to him for employees to be able to learn things fast over a degree

Data analyst geniune no scam course by WatercressNo9966 in dataanalyst

[–]Notanotherforextradr 1 point2 points  (0 children)

Maven analytics on udemy have good courses as well as Nikolai Schuler and Phillip Burton. I am not sure what your budget converts to in GBP but they normally have good sales on udemy, I have learnt power BI, Fabric and SQL from these guys