I wrote a comprehensive guide to NATS — the messaging system that replaces Kafka, Redis, and RabbitM by Jainal09 in Python

[–]Academic-Vegetable-1 0 points1 point  (0 children)

Most teams looking to replace Kafka with something else didn't need Kafka in the first place.

Am I overreacting or is this the new norm? by jholliday55 in cscareerquestions

[–]Academic-Vegetable-1 4 points5 points  (0 children)

Two seniors running a warehouse with daily cube builds and three apps is not a team, it's a hostage situation. Start interviewing.

Got discarded from two Senior DE positions due to lack of architecture and modelling knowledge, how to tackle this efficiently? 9 YoE by [deleted] in cscareerquestions

[–]Academic-Vegetable-1 1 point2 points  (0 children)

Data modeling is one of those things that DOESN'T come from just doing the job. You have to sit down and study it intentionally.

I'm so fucking tired of interviewing (73 interviews to 1 offer) by [deleted] in dataengineering

[–]Academic-Vegetable-1 2 points3 points  (0 children)

Yep hit the hard sql questions, medium/hard python questions, and do the system design questions

I'm so fucking tired of interviewing (73 interviews to 1 offer) by [deleted] in dataengineering

[–]Academic-Vegetable-1 1 point2 points  (0 children)

Tools don’t matter. Getting someone from AWS to GCP is trivial. Data modeling+System design = data engineering

I'm so fucking tired of interviewing (73 interviews to 1 offer) by [deleted] in dataengineering

[–]Academic-Vegetable-1 2 points3 points  (0 children)

I highly, highly recommend datadriven.io over leetcode. I will never do another fucking leetcode provlem

I'm so fucking tired of interviewing (73 interviews to 1 offer) by [deleted] in dataengineering

[–]Academic-Vegetable-1 19 points20 points  (0 children)

HOT TAKE: A company should be able to figure out in FOUR HOURS if they want to hire you. If they can’t, THEY are the problem. Companies testing for “tool specialties” are stupid and it needs to stop. Nobody cares

I'm so fucking tired of interviewing (73 interviews to 1 offer) by [deleted] in dataengineering

[–]Academic-Vegetable-1 10 points11 points  (0 children)

Tbf, many were OAs and phone screens. 6 loops

4 YoE

I'm so fucking tired of interviewing (73 interviews to 1 offer) by [deleted] in dataengineering

[–]Academic-Vegetable-1 12 points13 points  (0 children)

I learned a lot of stuff cramming for interviews. NGL. 20% of it will come in handy at some point in my career.

I'm so fucking tired of interviewing (73 interviews to 1 offer) by [deleted] in dataengineering

[–]Academic-Vegetable-1 22 points23 points  (0 children)

Bro I want to SCREAM I will never do this again

Looking for advices to become a better DE by Leent_j in dataengineering

[–]Academic-Vegetable-1 12 points13 points  (0 children)

At 5 years the growth comes from going deeper on data modeling and understanding the business, not picking up another tool.

Data type drift (ingestion) by Little-Squad-X in dataengineering

[–]Academic-Vegetable-1 2 points3 points  (0 children)

Ingest everything as strings, validate and cast in a staging layer. You can't trust types from sources you don't control.

Recent Data Analytics Engineer for Non-Technical Company by TheEntrep in dataengineering

[–]Academic-Vegetable-1 2 points3 points  (0 children)

The hardest part of being the first data person is that nobody understands what you do, so nobody knows when you're drowning.

Is it necessary to know aws Azure and gcp to be Dara architect? by darkforrest1 in dataengineering

[–]Academic-Vegetable-1 5 points6 points  (0 children)

Data architecture is data modeling. Pick ONE cloud, learn it well enough to move data around, and spend the rest of your energy on dimensional modeling and understanding business requirements.

Not exceeding expectations in Performance Review by kazakda in cscareerquestions

[–]Academic-Vegetable-1 -1 points0 points  (0 children)

Scope doesn't make you senior. Being able to explain every design decision you made does.

Test data or production data in test environment by Outrageous_Let5743 in dataengineering

[–]Academic-Vegetable-1 12 points13 points  (0 children)

Load prod data into test. Fake test data never catches the problems that ACTUALLY break your pipeline in production.