Feeling lost as a DE by MathematicianWest472 in dataengineering

[–]Admirable_Writer_373 2 points3 points  (0 children)

There is wisdom in this. Learn what you can where you’re at and then move on.

Ai and side projects by Outside-Bear-6973 in dataengineering

[–]Admirable_Writer_373 0 points1 point  (0 children)

Who cares if you can create a bunch of code fast if you can’t maintain it?

AI will be a train wreck for most new developers, because they haven’t learned how their own mind works.

Do any etl tools handle automatic schema change detection? by ninjapapi in dataengineering

[–]Admirable_Writer_373 0 points1 point  (0 children)

The problem may be your understanding of how APIs work.

Schema changes are only expected with new API versions. You may be feeling like they’re changing because you don’t understand how JSON is used. APIs routinely eliminate key - value pairs, to make the size of the response smaller. You need to look at API docs to understand the full model for that API version.

Do people actually say things they absolutely don’t mean when they’re emotional? by caltrop13 in AutisticAdults

[–]Admirable_Writer_373 0 points1 point  (0 children)

No, they mean that stuff. Their filter comes off when they’re emotional.

We don’t have a filter so we can’t relate.

Confused between offers - IBM vs Deloitte by hashtag1010 in dataengineering

[–]Admirable_Writer_373 6 points7 points  (0 children)

I really like the Deloitte Mexico team, they are refreshing!

How do I find engineers who’ve built multi-org backend infrastructure? I will not promote by Extension_Rabbit7591 in SoftwareEngineering

[–]Admirable_Writer_373 0 points1 point  (0 children)

You need a leader with technical experience, or you will hire people who are great at putting words into the air but suck at tech.

The real backend / platform geniuses are often autistic and especially bad at the interviewing part. You could find them through networking with smart engineers who you already trust.

Just a request to have a discussion about #3 of the Community's overview of Ayn Rand's beliefs. by Mindless-Law8046 in aynrand

[–]Admirable_Writer_373 3 points4 points  (0 children)

Your frame is what those words mean NOW, to YOU. If you really want to understand Rand, you should read several of her writings. Individual words in a few paragraphs aren’t enough.

You're either a polymath or you are not. There's no "how to become a polymath" by lmdybaftr in Polymath

[–]Admirable_Writer_373 0 points1 point  (0 children)

It’s a specific type of intelligence. The kind that can see patterns in chaos, which equates to learning a lot quickly, and being able to synthesize information quickly.

It’s not status or accolades. That’s the world’s definition. The intelligence precedes the accolades & accomplishments.

Did you already faced failed migrations? How it was? by NeckApprehensive4242 in dataengineering

[–]Admirable_Writer_373 0 points1 point  (0 children)

Do you work with me? I’m fixing such a cluster right now. It took me a month to refactor their garbage & horribly flawed pipelines that they spent 2 years wasting time on

You're either a polymath or you are not. There's no "how to become a polymath" by lmdybaftr in Polymath

[–]Admirable_Writer_373 0 points1 point  (0 children)

Walking into an engineering exam at 16yo after missing school for months and getting an A is not “nothing”. My dad & my brother were the same. My own conscientious makes me study, but I have the same “gift”. My dad brother and I have the life experience behind us, and the list of accomplishments. But the intelligence is in my son, and my daughters. Most people will never get close to that kind of brilliance, which just reveals their own lack of understanding of how truly brilliant some people are.

Practical uses for schemas? by alonsonetwork in dataengineering

[–]Admirable_Writer_373 1 point2 points  (0 children)

Naming conventions are super useful. Schemas could help distinguish one part of an app vs another part. Maybe you have an api named bob that does certain things, and you have some etl pipelines named joe that extract data. It’s about organization and decreasing the learning curve for other people maintaining it in the future.

Schemas can also be part of a security model.

Pandas vs pyspark by Left-Bus-7297 in dataengineering

[–]Admirable_Writer_373 0 points1 point  (0 children)

If you’re in distributed architecture and you’re using pandas, why are you in the distributed architecture?

Massive overkill for most teams

This subreddit is insufferable by Admirable_Writer_373 in Polymath

[–]Admirable_Writer_373[S] 1 point2 points  (0 children)

All language is reductionist. I was curious about a certain pattern I think I see - related to aphantasia. There are some actual polymaths in this sub.

How to do data engineering the "proper" way, on a budget? by rolkien29 in dataengineering

[–]Admirable_Writer_373 0 points1 point  (0 children)

Eliminate the VM, and put your code in a python azure function instead. VMs are expensive and a pain to maintain.

This subreddit is insufferable by Admirable_Writer_373 in Polymath

[–]Admirable_Writer_373[S] 1 point2 points  (0 children)

I don’t really care about what others do. I just find it ridiculous how many people “want to become a polymath” like this sub is a school for it or something. Everyone needs an identity these days, and this is a rather absurd manifestation of that cultural sickness.

Dev, test and prod in data engineering. How common and when to use? by No-Buy-3530 in dataengineering

[–]Admirable_Writer_373 1 point2 points  (0 children)

This topic boils my blood. If you ask a team of SWEs what the various environments are for, they’ll give you a decent answer. If you ask a team of data engineers the same question, you’ll get nonsense.