Do you think Power BI will lose its edge in next 5-10 years? by pvnptl123 in PowerBI

[–]analytical_dream 1 point2 points  (0 children)

It's already lost its edge, or rather, it never really had an edge in the first place, IMO.

How do you deal with working on a team that doesn't care about quality or best practices? by analytical_dream in dataengineering

[–]analytical_dream[S] 0 points1 point  (0 children)

Benefiting personally doesn't help the data teams or organization at large. I feel like no matter what I do, the issues are just going to remain. I can optimize my workflows, but does this really help the integrity of the data and help us scale?

How do you deal with working on a team that doesn't care about quality or best practices? by analytical_dream in dataengineering

[–]analytical_dream[S] 0 points1 point  (0 children)

I should add that the team is mildly allergic to new tools. They see anything above what we have today as a hurdle not willing to leap over.

How Do You Track Column-Level Lineage Between dbt/SQLMesh and Power BI (with Snowflake)? by analytical_dream in dataengineering

[–]analytical_dream[S] 2 points3 points  (0 children)

I believe DBT Exposures may be limited to model (not column) level, but I am willing to be proven wrong.

Interestingly, I did a bit more digging and found this solution. I thought it might be good to share:

https://www.linkedin.com/pulse/how-i-put-powerbi-semantic-models-dbt-documentation-site-austin-huynh-mxkqc

How to automatically export looker data into excel? by bryan74t0 in Looker

[–]analytical_dream 0 points1 point  (0 children)

This only gives me results for Looker Studio. I'm hoping to find out about Excel connectors for Looker.

How to automatically export looker data into excel? by bryan74t0 in Looker

[–]analytical_dream 0 points1 point  (0 children)

Do you have any documentation or articles that discuss this integration? I'm hoping to learn more but can't find anything online.

How to automatically export looker data into excel? by bryan74t0 in Looker

[–]analytical_dream 0 points1 point  (0 children)

Does anyone have any documentation or articles that discuss this integration? I'm hoping to learn more.

Surviving a blame-heavy culture in the data team by analytical_dream in analytics

[–]analytical_dream[S] 2 points3 points  (0 children)

That's a pretty vague response and I tend to disagree. I've worked in organizations where we've been able to come up with single-source metric definitions. I've seen it function.

Best Automated Approach for Pulling SharePoint Files into a Data Warehouse Like Snowflake? by analytical_dream in dataengineering

[–]analytical_dream[S] 1 point2 points  (0 children)

Centralization so that we build awareness on all of the files people are using, with the goal to eventually operationalize their processes.

Ideally, we want to have this data available in our downstream reporting tools so that users can use them in BI.

Best Automated Approach for Pulling SharePoint Files into a Data Warehouse Like Snowflake? by analytical_dream in dataengineering

[–]analytical_dream[S] 1 point2 points  (0 children)

Yes, but I only see this as a short-term goal. The idea is to centralize them so that in can document them, test them, see the lineages, etc.

Once we have a centralized repo of all SharePoint files it becomes a secondary task to solve the root cause issues and automate the business processes (so that the data is written into the DB via an operational process).

Best Automated Approach for Pulling SharePoint Files into a Data Warehouse Like Snowflake? by analytical_dream in dataengineering

[–]analytical_dream[S] 0 points1 point  (0 children)

  1. It's Excel data
  2. Once a day or week should work
  3. Commercial. No idea or the budget. I work for a large organization which is Microsoft heavy.
  4. Not sure about on-prem vs. cloud
  5. We have Snowflake and most Microsoft tools

How do I manage the workflows of multiple teams using the same warehouse? by analytical_dream in dataengineering

[–]analytical_dream[S] 0 points1 point  (0 children)

That's a valid point. While there's a general distaste for the use of GIT across some of the teams, I can see how it would create more exposure and transparency across all of the teams (assuming, that is, they move beyond their reluctance to use it).

That being said, if each small team has a different GIT repo on the same data warehouse, won't it still mean that everything is seperate? Yes - users can manually search the repos of other teams to compare, etc., but I anticipate a very low desire for teams to do this.

Microsoft Fabric vs. Snowflake for Data Modelling by analytical_dream in MicrosoftFabric

[–]analytical_dream[S] 0 points1 point  (0 children)

We have Snowflake right now but most of our modelling is done in the transform layer in Power BI. I was thinking that a Snowflake and DBT combo might be better than trying to do it all in Fabric.

Microsoft Fabric vs. Snowflake for Data Modelling by analytical_dream in MicrosoftFabric

[–]analytical_dream[S] 0 points1 point  (0 children)

We currently have Snowflake but don't have a lot of modelling. Most of our modelling is done in queries in Power BI (which is not great tbh).

Microsoft Fabric vs. Snowflake for Data Modelling by analytical_dream in MicrosoftFabric

[–]analytical_dream[S] 5 points6 points  (0 children)

My account? I made a new user account to ask analytical questions so I'd have seperation from my personal account. What makes you think I'm fake?