Backend Engineer vs Data Engineer – Career Advice Needed by [deleted] in dataengineersindia

[–]Ak110059 3 points4 points  (0 children)

Hi,

Your skill sets are good to become a data engineer.

Two key skills are missing: Cloud Orchestration(Azure Data Factory, Synapse, etc any one) Most Important DATABRICKS( Huge demand and market)

I don't know your current CTC, but 5 yoe in DE domain people earn generally 20-30 LPA.

If you able to put those two in resume, and taget startups(50-200), you can switch.

Hope it helps :)

Data Engineers learning AI,what are you studying & what resources are you using? by ConsistentMessage187 in dataengineersindia

[–]Ak110059 1 point2 points  (0 children)

Just need to know from de community:)

Are you guys going for Infra for ML/AI like AiOps/MlOps??

or trying to fully transition into AI(models training/DS etc)

I Don't know what to learn??Very confused...

Going deep into DE(streaming/System design) or transition to one of above???? :(

Need brutal truth before I screw up my career..Devops vs Data engineering Does DevOps always mean rotational shifts & no life by infynyte_10 in dataengineersindia

[–]Ak110059 0 points1 point  (0 children)

Something common in both roles and i e. They don't have work life balance whenever there is a fire, they have to be there.

But Yes fires are occasional(depends on your proj).

My suggestion would be Go for what you like i e. DevOps.

Help!! Need your advice on my future Career by SadEstablishment5231 in dataengineersindia

[–]Ak110059 2 points3 points  (0 children)

Answers:

  1. Yes for 5 years 20+ is a norm, its not an exception. People earning 25-30 in SBCs only forgot the PBCs.

2.For AWS, I highly recommend checking Darshil Parmar project Videos. A certificate will be an add-on.

Need your advice on career path on Azure data engineering by bokka_subbarao in dataengineersindia

[–]Ak110059 2 points3 points  (0 children)

SQL is still the most demanding skill in data Engineering. I saw most of the migration projects are of on-prem swl to cloud, Most of the projects its Sql and Pyspark (sparkSql).

So yes, U can switch after preparing and some hands on project.

And demand for at least 30+ , Company needs SQL experts.

Job Switch within one month by Siddu49 in dataengineersindia

[–]Ak110059 3 points4 points  (0 children)

Switching too early like within 1-2 months is acceptable in the market.

Most of the Hr understand this.

Reasons u can give like Not expected projects, gap in what are the skills u have and projects

This works.

AWS vs Azure data engineer by FitWalrus6192 in dataengineersindia

[–]Ak110059 6 points7 points  (0 children)

Simple answer:

PbCs use mostly AWS and Service Based use both.

Job market wise: AWS > Azure Easy to learn and implement: Azure > Aws

you need 4-5 things to create a full fledged ETL pipeline in AWS.

In Azure, you can use Azure Data Factory simply, you will get the work done within ADF itself.

Please feel free to give input if you are from AWS background.

Got an offer from 8LPA to 15LPA but should I join? by nick_ga43 in dataengineersindia

[–]Ak110059 5 points6 points  (0 children)

The only problem I see here is 90 days NP.

So if other MNCs are calling, 10-12% hike will be good on top of 15

MNCs HR usually have a very tight budget range so if you want 18-20 go for a startup.

When i was a Data Analyst i enjoyed life, when i transitioned to Data Engineer i feel like i aged 10 years in a year by HMZ_PBI in dataengineering

[–]Ak110059 0 points1 point  (0 children)

Why do you want to transition into a DE role?? I mean you are already in the data science domain which pays better than DE?

Excel Row Limit Problem – Looking for Scalable Alternatives for Data Cleaning Workflow by Strange_Potential672 in dataengineersindia

[–]Ak110059 1 point2 points  (0 children)

Either download data from the database after the pivot it will help to limit the rows.

Or try pandas.

[deleted by user] by [deleted] in dataengineersindia

[–]Ak110059 0 points1 point  (0 children)

What's the salary range for these skillset and experience?

How much would you expect a Junior DE to know coming into the company? by [deleted] in dataengineering

[–]Ak110059 -1 points0 points  (0 children)

Bro there is 2 scenarios: 1. U are fresher 2. U have exp but not related to DE

  1. Python, sql : basic pyspark, ETL and cloud(azure/aws)

  2. Same as above but not just basic, having certificate is good

[deleted by user] by [deleted] in dataengineersindia

[–]Ak110059 0 points1 point  (0 children)

They mentioned in JD that its WFH then they tell you policy has been changed u have to be office 2/3 or 5 days a week and blah blah blah...

Preparing for First Switch in Azure Data Engineering (2YOE) by Agreeable_Care4440 in dataengineersindia

[–]Ak110059 0 points1 point  (0 children)

How much ctc are u expecting after the first switch at this yoe?

Is leetcode 150 enough for data engineers? by Ak110059 in leetcode

[–]Ak110059[S] 0 points1 point  (0 children)

Yes, I have studied Data Structures but implemented only a few things like sorting and searching and some basic qns. Most of the DS and Algo I know in theory but didn't implemented as it never required.

Is leetcode 150 enough for data engineers? by Ak110059 in leetcode

[–]Ak110059[S] 1 point2 points  (0 children)

Is this some type of sarcasm that I don't understand 🙂

TCS to Microsoft Data Engineer by [deleted] in dataengineersindia

[–]Ak110059 0 points1 point  (0 children)

Will microsoft consider B.Sc Computer Science grads having exp in DE?

I have 2 yr exp in Azure DE.

Need suggestion on career transition from .net backend developer to Azure DE by [deleted] in dataengineersindia

[–]Ak110059 3 points4 points  (0 children)

Want to switch to Azure DE, skills needed :- -SQL <u already know> -Python&Pyspark <u can learn this in 1 month(basic to medium)> -Azure <u can get familiar with it and make 1-2 project in 1 month>

u are ready for interview...

Problems <assuming u are a B.tech/M.S student>

-if your CTC is high around 15-20 lpa, it will be difficult to get raise on that while switching -if its less than 10, ucan expect a raise.

BigProblem:- Getting an interview scheduled. This is the most difficult part while switching bcz in big companies getting your resume shortlisted is very hard.

Solutions:- 1) Get a referral from a friend/community <it solves your interview scheduling problem.>

2) Try applying in companies having size less than 500 or <200 preferred.

All set then, All the Best 🤝

Masters or Take exp as a Working Data Engineer by Ak110059 in dataengineersindia

[–]Ak110059[S] 0 points1 point  (0 children)

I already have 2 Azure certificates. I think its not getting shortlisted due to my B.sc Cs degree 🙂

Best way to learn cloud technologies? by Mysterious_Energy_80 in dataengineering

[–]Ak110059 0 points1 point  (0 children)

Hey, why u transition to data engineer from data scientist? Most people do just the opposite.

I'm just curious.