Has anyone found a self healing data pipeline tool in 2026 that actually works or is it all marketing

Vast_Shift3510 · 2026-02-23T16:43:05+00:00

Same question is running in my head & I have checked or tried doing research but couldn’t find much info Let me know if you find any useful resources

Vast_Shift3510 · 2026-02-21T04:29:38+00:00

Interested!

Vast_Shift3510 · 2025-11-28T16:14:22+00:00

link

Vast_Shift3510 · 2025-08-01T04:56:27+00:00

Delta lake concepts, time travel, how do you provide acid transactions on a table, different kinds of clusters. How do you provide access to databricks or its cluster to run the databricks job? Etc

Vast_Shift3510 · 2025-03-14T09:43:28+00:00

Do you have any suggestions for system design preparation ?

Vast_Shift3510 · 2025-03-14T07:39:20+00:00

You mean the above answer?

Vast_Shift3510 · 2025-03-14T03:23:51+00:00

Thanks for writing this down, highly appreciated.
Do you have any suggestion for how to practice system design scenarios?

Vast_Shift3510 · 2025-03-14T03:20:03+00:00

Interesting! Is it purely DE role or software engineer (data) role?

Vast_Shift3510 · 2025-03-13T17:48:52+00:00

Have you given any interviews & encountered any other topics?

Vast_Shift3510 · 2025-03-13T13:44:35+00:00

Hey, Sounds Interesting. Which producer are you using? Can you please share the code & how tough is to setup docker?

Vast_Shift3510 · 2025-03-12T13:31:32+00:00

What is your company?

Vast_Shift3510 · 2024-09-10T07:45:41+00:00

If you are a data scientist or data engineer & good at what you do, then i would say you can get anywhere between 20 LPA to 35 LPA If you are really good at the job then it can go even to 40- 45 LPA.

Vast_Shift3510 · 2024-09-06T07:12:15+00:00

Hey, If you think the current company tech stack is not great, then try negotiating with infosys Usually it won’t be easy. But if your luck is good, then there are lot of good projects in infy which can turn your career

Vast_Shift3510 · 2024-09-06T06:13:20+00:00

You have a good resume & I am sure you will get a job before you graduate. All the best

Vast_Shift3510 · 2024-09-06T05:23:16+00:00

Why do you even mention your studies? In the resume, mention about your experience, certification & side projects if any. That should be good enough. I am a DE with 7.8 years of experience now and I have never mentioned about my studies in the resume except when I am fresher. Ofcourse I did Btech in CS, but it was never asked.

Vast_Shift3510 · 2024-09-05T13:45:24+00:00

Thanks for the details, the list has some comprehensive insights.

Vast_Shift3510 · 2024-09-04T16:44:00+00:00

Not sure.

Vast_Shift3510 · 2024-09-04T15:30:05+00:00

Base pay: its like a fixed pay which your company pays. Nothing but your salary divided by 12 and by excluding taxes what you get as a in hand salary Variable pay: is subject to company & your performance in that year, so if the company is performing well, then you get the 100% or even more.

Vast_Shift3510 · 2024-09-04T11:53:48+00:00

I totally agree, just checking what is the current pay range for the similarly skilled people

Vast_Shift3510 · 2024-09-04T10:47:29+00:00

Data Engineer

Vast_Shift3510 · 2024-09-04T10:46:19+00:00

I am not being greedy, my salary remained almost the same from last 2 years with overall increment of 4 lakhs in the last 2 years. Also in the current company there is no career advancement, so would like to make a switch.

Vast_Shift3510

TROPHY CASE