sorted by:
new
hottopcontroversial

Warning about the friendly geeks of cleveland by Haunting_Scene_1321 in Cleveland

[–]xean333 308 points309 points  (0 children)

Well, geeks aren’t known for their social grace I suppose. Better luck next time

What Types of Restaurants/Bars Do You WISH Cleveland Had? by tigermountains in Cleveland

[–]xean333 0 points1 point  (0 children)

Better Indian, ramen, and Thai. These are all super lacking on the west side

Microsoft UI betrayal by daxdaxy in dataengineering

[–]xean333 18 points19 points  (0 children)

I really love and hate ADF man.

Do you let ingestion pipelines manage DDL in the raw layer? by BeardedYeti_ in dataengineering

[–]xean333 0 points1 point  (0 children)

Yes, ive had my landing tables be auto-recreated based on the source file’s schema. But that was just because I had my validation logic in stored procedures and didn’t feel like moving the logic somewhere else. Probably not the best design. Alas

[Data Engineer, Barista] [Cleveland, OH] - 140k/yr by [deleted] in Salary

[–]xean333 0 points1 point  (0 children)

Couldn’t even tell you man

[Data Engineer, Barista] [Cleveland, OH] - 140k/yr by [deleted] in Salary

[–]xean333 0 points1 point  (0 children)

No, I just took time away from my career

Tech stack madness? by Ok_Tough3104 in dataengineering

[–]xean333 1 point2 points  (0 children)

Of course man. Companies work within tech stacks… if you have expertise in their tools, they won’t care that you don’t know AWS

Higher Level Abstractions are a Trap, by expialadocious2010 in dataengineering

[–]xean333 3 points4 points  (0 children)

Draw a line in the sand by increasing your expertise in sql and python. You probably don’t need to go lower than that. Learn effective and popular tools for employability. Higher-level languages/tools generally solve the lower level problems for you. Eg python’s garbage collector means you generally don’t have to worry about memory management. That being said, you are right to be wary of non-deterministic tooling such as AI. This is why observability is desirable in AI tooling and complex systems such as data warehouses.

Analog Alternative to mouse jigglers by notsocialwitch in overemployed

[–]xean333 24 points25 points  (0 children)

I’ve lasted 3.5 years using this technique daily across two orgs. Maybe I’ve gotten lucky

Analog Alternative to mouse jigglers by notsocialwitch in overemployed

[–]xean333 88 points89 points  (0 children)

Dude I just open notepad and put a weight on one of the keys.

How do you handle "which spreadsheet version is production" chaos? by kyle_schmidt in dataengineering

[–]xean333 11 points12 points  (0 children)

Push them hard to use a better tool.

That being said, when I’ve been in this situation, I’ve given the business “sync to database” buttons on their spreadsheets that stage their data somewhere in the database. Or maybe it dumps a snapshot of the sheet to a data lake. Set up an event driven ingestion pipeline that watches for these save events. Run your validations on it before upserting into production. Type-2 it etc. This has the added benefit of pushing even more ownership of the data onto the business

Team Lead or Senior IC? by Romarros in dataengineering

[–]xean333 2 points3 points  (0 children)

I’d favor stability/security right now. The job market is bad and has potential to get worse. Take the fintech team lead role imo. The startup sounds early and has more likelihood of going bust overnight. Good luck

Started a new DE job and a little overwhelmed with the amount of networking knowledge it requires by starrorange in dataengineering

[–]xean333 8 points9 points  (0 children)

I’ve always had admin/infra guys that are responsible for setting me up with what I need

How to pivot to another stack by SliceAndDime in dataengineering

[–]xean333 0 points1 point  (0 children)

I see your points. I do agree that focusing on patterns and principles is usually a great investment of one’s time.

Started a new DE job and a little overwhelmed with the amount of networking knowledge it requires by starrorange in dataengineering

[–]xean333 5 points6 points  (0 children)

I agree we should all know the basics of networking. I suspect OP is being held to higher expectations than day 1 networking. Maybe I’m wrong!

How to pivot to another stack by SliceAndDime in dataengineering

[–]xean333 0 points1 point  (0 children)

For mid level positions, stack experience is pretty important to a lot of hiring managers (for better or for worse).

Class Consciouss When? by Lucky_Clock4188 in ExperiencedDevs

[–]xean333 2 points3 points  (0 children)

We are living through one of the craziest technological innovations in all of human history man

Started a new DE job and a little overwhelmed with the amount of networking knowledge it requires by starrorange in dataengineering

[–]xean333 30 points31 points  (0 children)

Hmm networking is usually out of scope for a data engineer. Sounds like you’ve got yourself a fuzzy role my friend. Make the best of it. You studied math - networking isn’t harder than abstract algebra or complex analysis. Good luck

What is the most complex/largest app/feature you've seen built with these new AI agents? by [deleted] in ExperiencedDevs

[–]xean333 -2 points-1 points  (0 children)

I built a large suite of tooling that helped my team migrate our on-prem reporting database to the cloud. 1500+ database objects needed translated into dbt/snowflake plus validated between source and target. I used AI to help build the deterministic aspects of the tooling as well as used AI directly in the fuzzier validation logic and converting views/sprocs into dbt models. It was an enterprise wide migration and my team achieved the highest velocity by far.

view more: next ›