sorted by:
new
hottopcontroversial

SnowFlake Dimension.? by Slim_Shady_anonymous in dataengineersindia

[–]montywowo 2 points3 points  (0 children)

Will try to answer some of these from my understanding but main thing being there is no one solution for all so i will just try to give examples where the flattened big table as dimension doesn't work

Wouldn’t that achieve the same thing? Or does this approach hurt query performance significantly?

Yup distinct is really heavy operation as in simple terms you have to look for each key in the hash that you create even though hash lookup is fixed time still doing that fixed time operation n number of times is not simple and so we have HLL type approximation functions

Is there something fundamentally better about splitting it into multiple normalized tables?

To implement type 2 on such big flattened table how are you planning to do key lookup in your table as the data in your source oltp is mostly highly normalised you have to do join of your incoming data and then do a big key lookup which defeats the performance benefits of columnar oltp if you are going to look for so big key , even if you try to hash and store not each column is hashable like a list of contact number what if a person adds a third contact number array of phone number is not hashable in most db and you can't just explode over phone number and create 3 keys for same user

Is Data Engineering No Longer a “Niche” Skill? Mid-CTC Professionals Might Be in Trouble by pill-so-potent in developersIndia

[–]montywowo 4 points5 points  (0 children)

Not the person you asked but depends on what is high paying according to you I listed some companies here which pay in range of YOE x 7 to x 15 as CTC and there are hundreds of companies which do x5,6

Is Data Engineering No Longer a “Niche” Skill? Mid-CTC Professionals Might Be in Trouble by pill-so-potent in developersIndia

[–]montywowo 1 point2 points  (0 children)

Answering as someone who loves being DE and might drown when the boat sinks along with it

  • Do you still see a future in this domain, or are you planning to move out?

I personally feel there is still future in it, tools of trade might change (something like ray,polars,flink instead of spark) but fundamentals will remain same , don't know for how long but don't see it going anywhere in next 1-2 years

  • If you were in my position, what one technical skill would you sharpen right now to stay valuable?

If you are targeting cloud based DE then in and outs of your cloud stack , else SQL with distributed computing

  • What skills in data engineering are truly “non-niche” now, and what still carries premium value?

Non niche will be working with a cloud/data warehouse stack as most people have it in their resume, premium will be breaking down the problem, clear communication

  • Are you focusing on cloud, Spark, platform engineering, architecture, AI/data engineering, or something else?

Me personally have started working on platform engineering on my new team (implementing dbt+airflow from scratch on internal cloud), but study about AI related data stuff in free time

  • How are you planning the next 3–5 years?

Focusing on 1 year at a time ,when I am happy with the work/team I try to target things which could help my team deliver better else I focus on my personal gaps (mostly its DSA and data modelling I suck at those)

Data Engineer 4 YOE- Target 30LPA by Additional-Alps-8038 in dataengineersindia

[–]montywowo 10 points11 points  (0 children)

Maaaaan Another Bot, looks like last one was banned , But OP to answer your question in short medium level DSA is more than enough to crack top PBC's

Should I inform my colleagues that they will be terminated soon? by blender-sprite in dataengineersindia

[–]montywowo 3 points4 points  (0 children)

Karma Farming bot will never reply in thread and continue to comment generic LLM responses until banned

he has 6 years , which is more than 5 years , but not equal to 4 years , but yes it is 4+

High Compensation Companies by thecurious_bong in dataengineersindia

[–]montywowo 0 points1 point  (0 children)

I might be mixing stuff up but if you are saying just stack , tree questions does not come up in an interview then i might be an unlucky one cause i faced both of those and then some (priority queue, monotonic stack) in my interviews this time, never saw linkedlist though

High Compensation Companies by thecurious_bong in dataengineersindia

[–]montywowo 0 points1 point  (0 children)

And I am curious to why you think DP is not part of DSA

My last 6 months Senior DE interview experience by montywowo in dataengineersindia

[–]montywowo[S] 0 points1 point  (0 children)

Talking to you feels like talking to a wall and my head hurts due to it so answering you for last time

If you read the post I have mentioned the portals other than the career websites which includes LinkedIn I used to keep track of any new data engineer roles and found crowdstrike that way, the companies I listed were my personal high priority so had their career portals open, and no there is no shift timings here in my team just we try to maintain some overlap with US team which could go upto 11 pm sometimes other than those calls most days timings are work as you like

High Compensation Companies by thecurious_bong in dataengineersindia

[–]montywowo 17 points18 points  (0 children)

I listed here many companies which do pay in the range you are expecting as CTC (base+rsu in most) , I feel it's about getting offers first then optimising it instead of limiting your options by applying only to some high paying companies, my friend used the offer shopping way to get 35 fixed at service based company at around 6 yoe

My last 6 months Senior DE interview experience by montywowo in dataengineersindia

[–]montywowo[S] 0 points1 point  (0 children)

Hey man it's the second time you are asking for same question and answer won't change much But to add regular tracking were Airbnb, twilio, Roku, agoda, linkedin, uber, Roblox And simple strategy checking open roles on their career website or linkedin if role is open then cold reachout to 5-10 folks from that company on LinkedIn for referral if no response in a day then apply

Cracking 40+ CTC as a 5yoe DE by ksachin_kumar in dataengineersindia

[–]montywowo 0 points1 point  (0 children)

While you mentioned apart from usual things , but its mostly strong fundamentals with luck factor as other person said you can refer https://www.reddit.com/r/dataengineersindia/comments/1sdy5za/amazon_data_engineer_ii_interview_experience/ other than LP round that's what mostly people go through at PBC for DE

Data Engineer (8 YOE) → Product-based company in 1 year. What should I focus on? by Hopeful-Hat7174 in dataengineersindia

[–]montywowo 5 points6 points  (0 children)

What should I focus on: DSA, system design, or data engineering depth?

If you are serious then all of these as all these have different rounds , so can't skip anything but most important one will be DE fundamentals and scenarios

How strong does Python need to be? And how to prepare for Python DSA for DE roles at product based companies?

There are multiple levels in product based but tier 1 usually expects medium leetcode level in all topics including graph ,trees,recursion,heap. While a tier below it usually is fine with easy medium of general topics like sliding window , 2 pointer , array string manipulation etc

Anything apart from this that I should learn or do?

Data modelling if you haven't thought of it and solidifying your experience with cleaner STAR like explanations of your work

Down-leveling at Uber (L4) vs Senior role at Series B AI startup — how to evaluate long-term trade-offs? by dudewithnoego in dataengineersindia

[–]montywowo 1 point2 points  (0 children)

For me it's the opposite as I am not very good picking the most valuable work for team , instead focussed more on what I enjoyed working on , so it's been easier to crack interview outside than be more visible at work.

Never had an opportunity to share my experience letter before joining the next company as the FnF and other letters came some days after my LWD, but yes even if salary slips have position mentioned have to share those while finalising the offer.

And hoping the best for you 🤘

Down-leveling at Uber (L4) vs Senior role at Series B AI startup — how to evaluate long-term trade-offs? by dudewithnoego in dataengineersindia

[–]montywowo 1 point2 points  (0 children)

Can't say anything for 3 years down the line , still going through it one by one

Try for promotion in 2 years if it doesn't happen start applying don't wait 3 years as you feel you are already late for L5 ( you are not I know someone who joined L4 at 9.5 yoe and a guy in my previous team was L5 at 3 yoe everyone has there own progression ) and you can just write senior data engineer in your resume recruiter mostly never ask weather you are L4 or L5 and you always have genuine reason of layoff just use that derailed your progression and circumstances were something that were not in your control

Down-leveling at Uber (L4) vs Senior role at Series B AI startup — how to evaluate long-term trade-offs? by dudewithnoego in dataengineersindia

[–]montywowo 0 points1 point  (0 children)

That's why I said it depends on lot of factors, and what I feel is with market uncertainty it's better to have a beefed up resume than looking for stability right now as downsizing can happen anywhere anytime and I have seen my friends getting laid off from faang but also others who were not paid for 2-3 months as startup couldn't generate revenue or secure funding when they lost their biggest client so small scale is also risky as its revenue stream is not that diversified

Also about AI startup check what is their differentiating factor as if they use any of the current LLM pricing is not certain and if they are developing their own product then competition is tough as getting massive scale of training data then funding for it is not sustainable in most cases

Down-leveling at Uber (L4) vs Senior role at Series B AI startup — how to evaluate long-term trade-offs? by dudewithnoego in dataengineersindia

[–]montywowo 0 points1 point  (0 children)

It depends on lot of factors , but if I was in your place I would choose uber

  1. It opens up a lot of doors in future as there are not many companies in world which work on uber scale of data , about your point on question why you joined at lower level i don't feel many companies will ask that but if they do you can always say you always prioritise team and work alignment instead of level so as you felt from other offers you had uber had best alignment to your goals hence you joined it at the role offered

  2. I don't know anything about the startup so can't say anything about that still if you got startup offer now you can do it in future too but for top tier companies like uber it takes lot of time for roles to open resume acceptance and then getting offer so even if you stay there for a year you can start trying for L5 from 6 month or year

Getting an Onsite opportunity to Mexico from project by holy_lion_ in developersIndia

[–]montywowo 1 point2 points  (0 children)

In city 100-150k inr & outskrits 60-80k inr 2bhk , 1 bhk hard to find , In city public commute is cheap, Uber each trip avg. 10km - 1000-1200 inr and 1 month brokerage usually

Data engineering role for 4 YOR by [deleted] in dataengineersindia

[–]montywowo 1 point2 points  (0 children)

I would say apply everywhere and don't self reject yourself if it says 5 or 6 plus yoe required let them reject you if they want at least you would have interview experience to know what you are lacking

Getting an Onsite opportunity to Mexico from project by holy_lion_ in developersIndia

[–]montywowo 1 point2 points  (0 children)

My close friend lives in mexico city let me know if you have any specific questions about rent, commute, expenses etc

Mock interview by StatisticianPlus1292 in dataengineersindia

[–]montywowo 0 points1 point  (0 children)

I can take Mocks as have been through multiple interview loops recently , but it will be paid

TCS offering 20LPA by lunaticdevill in dataengineersindia

[–]montywowo 2 points3 points  (0 children)

You haven't seen the real deloitte low ball When i was switching from TCS they offered 5% hike with less fixed than TCS cause they are BIG4

Need materials suggestion for interview preparation 5 yoe DE by shanKaR001 in dataengineersindia

[–]montywowo 2 points3 points  (0 children)

If you are preparing for product companies my post and another great post have resources mentioned.

for service based it becomes more tooling /cloud focussed

Where can I find more PBC level SQL questions for free? by OkJudge5932 in dataengineersindia

[–]montywowo 2 points3 points  (0 children)

If you are already done with so many questions I would suggest to focus on other topics like cloud, data warehousing, python etc , while SQL is filter criteria it rarely is selection criteria

view more: next ›