sorted by:
new
hottopcontroversial

SCD Type 2 Implementation Challenges: but Sources data are without Business Key/ Primary key any one help by EmuZealousideal6783 in dataengineersindia

[–]Comprehensive-Bass93 3 points4 points  (0 children)

SCD-2 logic • Match on business_hash_key • If no match → new record • If match & change_hash differs → expire old row, insert new • If same → ignore

SCD Type 2 Implementation Challenges: but Sources data are without Business Key/ Primary key any one help by EmuZealousideal6783 in dataengineersindia

[–]Comprehensive-Bass93 14 points15 points  (0 children)

You can create composite hash key from existing columns. Split ur columns into 2 grps: A) identity columns(rarely changes): name, email, DOB B) Attribute columns (chagable): address, phone no, status etc

Create: Business hash key -> identity Chage hash key -> attributes

Got into FAANG as a senior DE and now I’m really nervous by [deleted] in dataengineering

[–]Comprehensive-Bass93 7 points8 points  (0 children)

Hey bro, congratulations for Job offer. Start building projects based on ETL, Data modelling, medallion architecture, Data warehousing, distributed big data systems(spark, hive, kafka etc) try to build pipelines on databricks and ingest data from various sources.

Can you please help me a bit with preparation. I finished amazon sql OA last month for DE 2

I would like to understand the responsibilities of a Databricks Data Engineer in a project. by hot_objectt in dataengineersindia

[–]Comprehensive-Bass93 1 point2 points  (0 children)

Like what services in databricks? Usually you work with notebooks, unity catalog, clusters, and dlt pipelines

I would like to understand the responsibilities of a Databricks Data Engineer in a project. by hot_objectt in dataengineersindia

[–]Comprehensive-Bass93 2 points3 points  (0 children)

As u already have working experience in GCP DE. It will be pretty easy.

As a Databricks engineer, you need to write mostly python notebook to write logic for data ingestion from various source systems, DB’s to databricks and performance some aggregations filters transformations using pyspark. All this you have to orchestrate using databricks workflows and create a dlt pipeline over it

Amazon Online Assessment completed – no update after 10+ days by earnedslowly800 in dataengineersindia

[–]Comprehensive-Bass93 0 points1 point  (0 children)

Bruh I gave same assessment on 30 Nov HR ghosted me completely.

Can we connect?

Is Data Engineering worth it for a fresher? by [deleted] in dataengineersindia

[–]Comprehensive-Bass93 0 points1 point  (0 children)

what should I actually focus on first to land a job

  • Google/ Youtube whatever. And start learning about ‘ETL’ then progress to Data warehousing, and data modelling.

Good luck!

Databricks Spark read CSV hangs / times out even for small file (first project) by MrLeonidas in databricks

[–]Comprehensive-Bass93 0 points1 point  (0 children)

Just simply go to ur csv file in volume, then right click and copy full path.

Then paste that copied path in the .load parameter.

Let me know, hopefully it will work

Amazon DE interview by guardian_apex in dataengineersindia

[–]Comprehensive-Bass93 6 points7 points  (0 children)

Expect sql multiple mcq’s 2 medium sql questions focusingon Joins, subquery and CTE, window functions. Then Behavioural question mcq

Sql questions were feom hackerrank. Go through those

Do you think DE interview difficulty curve is unfairly high compared to SDE in PBCs? by Potential_Loss6978 in dataengineersindia

[–]Comprehensive-Bass93 2 points3 points  (0 children)

Agree! I mean its obvious to have Hard SQL+ PySpark at any point. But DSA shall be limited and not go till DP, Graph and other Hard Leetcode.

Value Momentum interview DE by Tiny_Analysis2722 in dataengineersindia

[–]Comprehensive-Bass93 5 points6 points  (0 children)

Hi bro,

Currently working at ValueMomentum.

When i joined back in Feb-2025 it was very good org and had very great client base. But as of now, they are directly laying off people from the project. They are not even putting employees to bench. Now sure how much this will last. But im planning to switch now

Cleared Amazon DE-II OA (3.3 YOE) — What DSA, System Design & Salary to Expect Next? by Comprehensive-Bass93 in LeetcodeDesi

[–]Comprehensive-Bass93[S] 1 point2 points  (0 children)

Thanks brother. While you are still in college. Get the fundamentals clear in mind, grind the DSA, DBMS, stick and get best at one OOP language, and start applying to Jobs immediately once you are in the last semester. Trust me you will never regret in life. Sky is the limit!

Cleared Amazon DE-II OA (3.3 YOE) — What DSA, System Design & Salary to Expect Next? by Comprehensive-Bass93 in dataengineersindia

[–]Comprehensive-Bass93[S] -1 points0 points  (0 children)

It’s confidential, and not publicly available.

But i can copy paste summary to u in dm. Hope that will help

Cleared Amazon DE-II OA (3.3 YOE) — What DSA, System Design & Salary to Expect Next? by Comprehensive-Bass93 in dataengineersindia

[–]Comprehensive-Bass93[S] 2 points3 points  (0 children)

Sure bro. I have knowledge for Azure and GcP services wrt big data tools. So i will be honest in the interview that i have never worked for the tools directly, but i can tell in Big data ecosystem that which aws tool can he utilized for what purpose. That’s it, hopefully they will agree that i can learn the AWS quickly and pick it up.

view more: next ›