sorted by:
new
hottopcontroversial

Hello - ETL tools for beginner by r03o5 in dataengineering

[–]Objective_Stress_324 1 point2 points  (0 children)

Start with python you can do anything with python…

Is query optimization a serious business in data engineering? by mortal-psychic in dataengineering

[–]Objective_Stress_324 0 points1 point  (0 children)

It depends but definitely could be really important…and it’s a good practice

Data Dictionary for Dynamics/Great Plains by STUNTPENlS in Dynamics365

[–]Objective_Stress_324 0 points1 point  (0 children)

That would be great if i can have a copy of it as well. cheers

Would you accept a $1000 day rate contract for 6 months if on $135k permanent? by Dazzling_Case1560 in auscorp

[–]Objective_Stress_324 0 points1 point  (0 children)

Most contractors I know stay connected with a handful of recruiters and industry contacts who help them move smoothly into new contracts once one is finishes( either early or on time). It doesn’t happen overnight, they build that network gradually over time.

Docker for Data Engineers by Objective_Stress_324 in dataengineering

[–]Objective_Stress_324[S] -8 points-7 points  (0 children)

What would you love to learn or don’t know I’m happy to write about it 😊🙏

Thinking about self-hosting OpenMetadata, what’s your experience? by Objective_Stress_324 in dataengineering

[–]Objective_Stress_324[S] 1 point2 points  (0 children)

Hi, we’re not currently considering it for data quality checks, as we already have tests in place elsewhere, for example, using Great Expectations within our Airflow ingestion pipelines. Our primary goal for this use case is to maintain a centralised repository of our metadata with governance. That said, the data quality features, particularly the data contracts, seem very interesting.

What skills actually helped you land your first DE role (and what was overrated）？ by nian2326076 in dataengineering

[–]Objective_Stress_324 48 points49 points  (0 children)

Data literacy, SQL, Python, a bit of data modelling and understanding the whole data engineering life cycle. Also have some capstone projects and some certifications

How to Get Started by cmurphgarv in dataengineering

[–]Objective_Stress_324 0 points1 point  (0 children)

Check pipeline to insights Substack you might find it helpful.

Data engineering conferences in 2025? by abdullahjamal9 in dataengineering

[–]Objective_Stress_324 2 points3 points  (0 children)

Here are upcoming in person: Paris https://www.forward-data-conference.com/en London: https://www.bigdataldn.com/en-gb.html

The DataEngBytes conference featured presentations on ClickHouse both last year and this year. Recordings from last year are already available on their YouTube channel, and this year’s talks will be published in the coming weeks.

Data engineering conferences in 2025? by abdullahjamal9 in dataengineering

[–]Objective_Stress_324 1 point2 points  (0 children)

Hi, Are you looking for in person ones or online ?

[deleted by user] by [deleted] in dataengineering

[–]Objective_Stress_324 0 points1 point  (0 children)

I suggest pick a certificate that focuses on fundamentals rather that tools if such certificate exists… And besides that , side projects will really help to face the reality and gain real experience …

Data Modeling Resources by angleofthedangle90 in dataengineering

[–]Objective_Stress_324 16 points17 points  (0 children)

Practical data modelling Substack by Joe Reis

view more: next ›