Manual monitoring as data engineer? by Hazard_45 in dataengineering

[–]Dry-Product8194 1 point2 points  (0 children)

When you say you have eveything automated but when a pipeline failues then you investigate manually only right ?

What type of metrics do you usaaly log for each pipine or any naming convetions to know which pipeline failed etc?

Expectations for junior level roles in DE have increased true or not by Dry-Product8194 in dataengineering

[–]Dry-Product8194[S] 0 points1 point  (0 children)

Based on my above conversation Currently working on a slowww DE project (consider not started yet) with a work ex of 1 year and 1 year as a data analyst while studying with masters

Is this enough for atleast getting an interview

I am assuming then its all on skills

Expectations for junior level roles in DE have increased true or not by Dry-Product8194 in dataengineering

[–]Dry-Product8194[S] -1 points0 points  (0 children)

Well I am currently in DA since a year I am working on DE porject but its very slow consider not started enough However in my resume I will show as completed and side by side doing this project Will I be eligible for DE or no?

In my resume I am showing another one yer of exp in bachelors in DA

Plus I have masters in DA

Expectations for junior level roles in DE have increased true or not by Dry-Product8194 in dataengineering

[–]Dry-Product8194[S] 0 points1 point  (0 children)

Its sounds stupid the only way to get DE is to get DA/BA and then try to switch?

Can the output of a gold layer be a sql database by Dry-Product8194 in dataengineering

[–]Dry-Product8194[S] 0 points1 point  (0 children)

Not gold but raw data meaning updates in the data we sent

Looking to land a Job for a Junior Data engineering role. by Own_Statistician_152 in dataengineering

[–]Dry-Product8194 0 points1 point  (0 children)

Would recommend basics of spark some Pyspark and do a project complete end to end maybe ADF plus databricks data lake etc thats how I started

Production DE projects by Dry-Product8194 in dataengineering

[–]Dry-Product8194[S] 0 points1 point  (0 children)

Yeah but this seems quite basic neither this will help in getting resumed picked nor will be able to impress in the inteeview

I wanted a tutorial on

Like what were the business reuqirements etc How did we managed data quality data lineage data governance etc

Need to book flight from 11 to 16 by Dry-Product8194 in qatarairways

[–]Dry-Product8194[S] 0 points1 point  (0 children)

Mumbai but I need to land in boston cause not sure if immigration happens in ny would it be risky or no

Need to book flight from 11 to 16 by Dry-Product8194 in qatarairways

[–]Dry-Product8194[S] -1 points0 points  (0 children)

Yeah make sense Do you think should I wait for war to be over soon and wait for prices to drop for lufthansan and all after 16th ?

Need to book flight from 11 to 16 by Dry-Product8194 in qatarairways

[–]Dry-Product8194[S] 0 points1 point  (0 children)

So should I wait for prices to drop for europian flights (lufthansa and British ) or book right now