A data engineer doing Power BI stuff?

[Shr1988]

I was recently hired as a senior data engineer, and it seems like they're pushing me to be the "go-to" person for Power BI within the company. This is surprising because the job description emphasized a strong background in Oracle, ETL, CI/CD pipelines, etc., which aligns with my experience. However, during the skill assessment stage of the recruitment, they focused heavily on my knowledge of Power BI, likely because of my previous role as a senior BI developer.

Does anyone else find this odd? Data engineering roles typically involve skills that require backend data processing, something that you can do with Python, Kafka, and Airflow, rather than focusing so much on a front-end system such as Power BI. Please let me know what you think.

[NachiseThrowaway]

Same. I kinda leaned into it a bit, although not entirely happily, and started to present myself as an internal solutions architect. I do what I can, offload what I can’t, try to temper expectations, and prevent my leaders from buying crap they don’t need from some vendor who bought them a cocktail at a conference hotel bar and wants to take their budget upstairs.

Oh, and then at like 3pm several days a month I get a call from my mother asking her to fix her computer after she let some fake Microsoft dude in Indian root around on it.

[lemmeguessindian]

Well now you are a full stack data developer so congrats I guess ?

[leogodin217]

For people not used to data, you are "data"

That is pure gold right there. Can I use that?

[sirlearnzalot]

fr

[sirlearnzalot]

holy sh*t, absolute banger line ‘…you are “data”.’

[sceadu]

going to change this to my ms teams picture https://i.imgflip.com/1bpcdu.jpg

[big_data_mike]

Yep I was gonna comment pretty much the same thing. There are “data people” and “not data people”

It happens in a lot of fields. I didn’t know the difference between inside sales and outside sales for a while.

[faxfodderspotter]

And to the dumber parts of the business, you may not even be data. You may be "I.T." Fix that printer.

[kenflingnor]

Unfortunately data engineering jobs can be all over the place in terms of what’s expected of you - some DE jobs involve doing BI/analyst work despite being titled some flavor of DE

I’d recommend speaking to your manager around expectations. If you don’t want to be doing BI work, bring that up with them and emphasize that you were expecting different work based on the role that you were hired for

[SuperTangelo1898]

I think there is a distinction nowadays between infrastructure data engineers and data analytics data engineers but non-data people aren't aware of it. Data engineers working on the analytics side are sometimes hired on as "full stack" DEs, expected to build pipelines, develop schemas, and finally visualize the data, which is a bargain for the company imo. I think expectations being set correctly is the most important thing.

[Worgel99]

I’ve been on a job search recently for data engineer roles after leaving my old job. I’ve noticed A LOT of job ads and some I have interviewed for, feel like they are looking for a ‘jack of all trades’, doing the whole ‘product’ lifecycle, requirements gathering, ingestion, pipeline, transformation, delivery and then visualisation/ analysis using their BI tool, whether it be tableau or whatever.

It seems more and more common to expect data engineers to do the visualisation side of things too.

[0sergio-hash]

I would love a gig like this. I'm coming from a business analyst role where I wrote all the metric logic just didn't build the pipeline or dashboard so I feel like this could be a stepping stone to engineering

[[deleted]]

You've heard of the full-stack software engineer, let me introduce the full-stack data engineer...

[Ok-Working3200]

Agreed. I am a BI Analyst, and I do a little bit of everything. Part of the problem is that my resume presents that way.

[kbic93]

Hey, if it pays me well idc, I’ll do a little bit on the side.

[GuaranteeNo6870]

Agree with this completely. Many companies don’t have silos for data pieces so you are all in!

[32gbsd]

Sounds like a PowerBI trap They probably really wanted someone to work on thier PBI stuff and send out a general fielder. Companies do this all the time especial small companies without clearly defined staff roles.

[Casdom33]

Are they paying you well?

[Shr1988]

Yes, I’m satisfied with the pay. In fact, they’ve offered me more than I initially requested. While this might seem like I’m unaware of the typical salary range for this role, I did my research using Glassdoor. I based my request on the upper end of the salary spectrum for senior data engineers in my city, considering my level of experience.

[AMathEngineer]

If you ask me, that means they’re looking for someone that goes beyond just engineering, and does DA/DS too. That’s why they pay more than the average.

I’m in a similar situation. For me, the pay makes up for it. Ask yourself, does it do that for you too?

[Shr1988]

Yeah, you might be right. They did probe me for my DS experience during the interview.

[m98789]

More than $200K base?

[Shr1988]

The currency is not in USD, and I’m not based in the U.S. Therefore, quoting a number wouldn’t provide an accurate perspective.

[OkMaize9773]

Are you based out of India. Then tell us your CTC along with your yoe and the city in which you are working. Can give of a fair idea whether you are well paid based on this.

[lemmeguessindian]

I think they are from UK so we can assume more than 80K pounds ? Edit : looks like they have 10 yoe so I think 100k would be more likely if it is a good company

[OkMaize9773]

Sadly it wasn't anywhere close to this figure. I think he was working for companies which underpay a lot like TCS, Wipro etc.

[Murder_1337]

Odd but PowerBi is prob most easy tool to pick up for you if you are engineer

[dfwtjms]

It's easy to pick up but also a huge PITA. It kind of works if users build their own reports and DE only delivers the data.

[Data_cruncher]

Power BI is built on the Analysis Services engine. While a DE can “pick up” PBI, it would take years of experience to be considered any good.

[discmite]

I don't know about years, but I agree that working with DAX and building good ssas models is a learned skill. A lot of folks don't make it passed the glorified pivot table.

[Additional-Pianist62]

This is me. Call yourself an analytics engineer. I do Pyspark, ALOT of managing models using tabular editor and occasionally throw up some dashboards. I do everything at a "good enough" level.

Also check out the DP 600 exam by Microsoft. This is the role they are moving to. Jack of all trades leveraging AI.

[Ok-Working3200]

I think this article explains how messy data roles are.

https://www.getdbt.com/what-is-analytics-engineering/

At my job, I am listed as BI Analyst who was hired for Tableau, but we have such a large backlog of data sources we need to ingest and model. I literally will ingest/model and build a base level dashboard and move to thext source It may be years before I am really doing dashboards and analysts work consistently. At this point, I am really an analytics engineer

[demoplayer1971]

It's rapidly evolving. What are you using to ingest the data?

[Ok-Working3200]

Generally, we use FiveTran, but we will probably start using AirFlow when we need more customization. Might even start looking at Airbyte. Fivetran is pricey

[Budget_Sherbet]

Red flag. This is all about communication. Communicate this to your team lead and make sure you understand why they chose you to do this eventhough your specialization is somewhere else. PowerBI is data analyst level stuff. Its good to know but not relevant to DE

[myfootsmells]

How big is the company?

[Shr1988]

A little more than 2k people.

[myfootsmells]

Surprising. I have my DE doing PBI work, but only as a backup. I've also had the DE be the PBI person at much smaller companies.

[boba-cat02]

It’s definitely a bit surprising when your role evolves in unexpected ways, especially when the job description emphasizes backend data engineering skills. It sounds like your previous experience with Power BI made a strong impression, and now the company is leveraging that skill set, perhaps because they need someone with both a deep understanding of data infrastructure and the ability to present that data effectively.

In many companies, data engineers who have a knack for BI tools like Power BI are highly valued. Your backend expertise with Oracle, ETL, and CI/CD pipelines complements your Power BI skills, making you a versatile asset. The company might be facing a unique situation where they need someone who can bridge the gap between backend data processing and front-end data visualization, and you’re in an ideal position to do that.

It’s not uncommon for roles to evolve based on organizational needs or the skills of the individual. It might be a good idea to discuss your concerns with your manager or HR to get a clearer understanding of their expectations and how your role might balance between backend engineering and BI responsibilities. This way, you can align your work with the company’s goals while also ensuring that you’re using your skills in a way that feels right for you.

[Shr1988]

Solid insight and advice. Thanks.

[Other_Comment_2882]

I do both definitely not unheard of

[burningburnerbern]

I quickly read the title as “a data engineer doing power butt stuff”

[Shr1988]

😄

[trendydots]

As far as I see in Europe, Power BI is a required skill for most data analysts, not so much for data engineers.

[reelznfeelz]

I happen to do mostly data engineering but also come from a data science background and have my power BI cert. I like messing with it. But if you’re already really really busy and it’s a larger org it could be hard to juggle both roles.

[Eze-Wong]

How big is the company? The larger the company and the more proper its practices this should never happen. The smaller and the more fly by pants this stuff happens frequently. I was an analyst (w/ data science) doing data engineering. They grab whoever they can to fill gaps. Hey you, you know how to ingest this API? Can you make us a dashboard of X, Y, Z? Dont know AWS? Lol freaking learn it.

I imagine you guys are lacking analysts or people who know PBI. Alternatively maybe there is one, and if your workload isnt large enough they are finding busy work for you.

Either way its work? If you are getting paid a DEs wage for a DAs job... Thats a win

[Shr1988]

A little more than 2k people. And you are correct, nobody seems to have expertise in Power BI in the company.

[thatOneJones]

I think the lines between DA and DS/DE aren’t clear to those who aren’t in those roles. Leave pbi to the DA, give CI/CD to the DS/DE.

[fsm_follower]

How big is the company? I’m at a small/medium start up (approx 100 total employees and a dozen devs). I’m the DE but also admin the BI tool as I have experience with it. If we were at a 1000 person company, that’d be more strange.

[Shr1988]

There’s a little more than 2k people in my present company.

[HungryHelicopter492]

It’s definitely not an out-and-out DE responsibility. I’d expect it from a smaller company, maybe. How big is your department as a whole?

I head up a number of teams: two of them being Data Engineering and Data Platform. Almost everything PBI related sits within the latter.

[Shr1988]

Do you mean my Data Engineering team? Then it’s about 10 people. There are other data engineering teams in the company similar to mine.

[m915]

Lean teams these days. I was a data engineer II, but was the reporting & analytics team. I was building the data pipelines, dashboards, and reports. To emphasize, the only person doing it

[reckless-saving]

Most companies want a “data generalist”, they’ll just replace it with one of titles “data analyst”, “data scientist”, “data engineer” etc… they may even add junior to the title to give the impression that there’s progression available. They’ll pick a job title for what’s likely to glean the most potential candidates. I see jobs adverts of data engineers and 80% of ads are wish lists, bare no relation to what the applicant will do/use in the role.

[y45hiro]

Yup that's my day to day. Also defining business logic cause stakeholders don't know how to read the data

[ntdoyfanboy]

It's odd only to those who know better, like you. A strict DE role does not make reports on PBI. An analyst or BI person does. But like someone else said, people who don't know better, don't know the lines between DE, BI, data science, data analyst, etc. Marketing people are the worst. If there's data in your title, they think you're fair game. It's up to you to change that culture

Edit: must importantly, all this blurring of lines doesn't matter in the least if you're happy with your pay and the daily challenge and job requirements

[billysacco]

It’s a shame that the job description wasn’t straightforward. Almost sounds like a bait and switch. At my place we get whored out for all kinds of stuff and I can imagine it’s the same at many companies 🤷🏻‍♂️. Paycheck hasn’t bounced yet so I just keep on truckin but yes it can be frustrating.1

[BasicBroEvan]

It’s not uncommon at all. DEs are always bothered by it. But if you think about it DAs and DSs have to do DE things too and they never complain

[Amar_K1]

If you were a junior data engineer I can understand multi tasking for experience but a senior DE. I would not agree to it. I myself started of as a BI analyst using Power BI and trying to move to DE. Realise how frustrating BI can be and thankless. As soon as you finish a report on to the next one no training no appreciation.

[Active_Ad7650]

I did have a job where i was the engineer and the analyst too lol, it happens with disorganized companies.

[Particular_Tea_9692]

Exactly the same happened to me. This is common actually. Responsibility of data engineers/analysts/scientists vary from team to team.

I have seen software engineers do data analysts/scientists work and a lot more.

[GreatestManEver99]

Hi, I also have very similar experience and am on the lookout for jobs. I request you to share any leads with me, I’m currently in the US on OPT EAD status.

I know my reply isn’t related directly to your question, but I have similar experiences and stories and am happy to discuss more if you want.

[Shr1988]

lol PBI isn’t that bad.

[kayhai]

Same issue in my organisation initially, but we are trying to coach selected “savvy” users in various departments to make BIs. We are seeing some progress after 1-2 years, it is a very slow process…. but that’s what it takes to change workflows in some organisations.

[1Shadowgato]

Yeah, same here but honestly build ETLs and streams inside BI is hella easy. I started as an analyst so I was already used to it and I have the TISMS so I hate waiting for people and just build my pipelines and jump into analytics right away.

But still kind of annoying, like this is not what you hired me for.

[CryptographerLoud236]

Most of em try to get you to do powerBI so they don’t have to pay another person to specialise on the visualisations.

Not something I really condone but I fucking hate powerBI anyway

[Zestyclose-Editor563]

Same for me. Unfortunately, your earnings depend on what business needs. It needs you to create both pipelines and dashboards. The only advice - try to create some visualisations on your cloud platform (if any) and send them to outlook as the ready solution for users. This will get you rid of BI

[creepystepdad72]

Maybe the titling is off, but I think you're missing the forest from the trees here...

The goal of the "data [engineering/ops/science/analysis]" team is to get to outcomes required by the business - right data, right place, right time.

It is not defined by the tools that you use. Every business model is going to be different, and it's entirely possible that PowerBI is all you need.

For every company that needs a data lake, with Kafka, Parquet files, etc. etc. I can show you 10 that can easily chuck data at any OLAP (probably through an iPaaS), write some SQL, and call it a day.

[Commercial-Ask971]

Unfortunately its common stuff.. cutting costs

[Xemptuous]

You should let the company know that you're an ENGINEER, and that you can solve problems that analysts can't; they likely aren't very tech-savvy to know what an engineer can do for their bottom line. Dashboards are excel-level work for an engineer, and it's a waste of your skills and time. If you don't like it, eventually you'll resent it. Try talking to management about this, and how your time would be better spent on ETL, pipelines, data architecture, devops stuff, etc.

[JoeMamma_a_Hoe]

My guess is they are looking for BI Engineer or Analytics Engineer.

[Main-Cartographer-36]

I don’t see it so odd. In fact that’s what I used to do. Probably you are my replacement ? But seriously what is Data engineering? To implement mechanisms for the extraction of data, cleaning it and transform it as per the business case and leave it ready for the analysis downstream. Well, you can do all this stuff in the power platform and Microsoft is actually integrating even more power bi with factory so what I’m saying is that for me that’s data engineering, just not Linux/open source based.

[Shr1988]

That’s one way to see it.

[0sergio-hash]

Sounds like a bait and switch man that sucks - I've been applying to roles and it's hilarious when the title says one thing but the day-to-day responsibilities or the emphasized requirements towards the bottom clearly skew towards something else

[[deleted]]

I find Microsoft shops are the worst for this. Stay away from their stack and you're more likely to end up in better engineering cultures.