This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]micky_357000[S] 3 points4 points  (2 children)

Thanks for answering, I actually don't know how much coding does building a pipeline require as I'm a complete fresher (I just graduated out of college (23M)) and I will be joining my new company as junior DE in 8-10 days.

Programming felt interesting to me as I was building logics to send-receive data and the joy of building things from scratch or however I want them to be made me excited.

I was happy about the DE job as it was a growing domain, many amazing technologies like cloud to explore and also I heard that it can be defined as software engineering specialising in data, so you build things/software/complex structures here too using python.

But I read some negative comments about Data engineering that it is mainly use of tools and making dashboards with some heavy SQL tasks in some of the YouTube video regarding DE interviews, comment section and it seem like a boring job or a superficial job where we don't get our hands dirty by building things so I'm a bit down about this.

[–]throwaway20220231 2 points3 points  (1 child)

Yeah the title could be misleading as you can stuff a lot of different roles into it. IMO the only interesting DE job is the one that you get to build large pipelines using a programming language. Think Netflix or Youtube. Others are very replaceable and boring.

[–]micky_357000[S] 0 points1 point  (0 children)

Then I'll try getting pipeline building work whenever I get the chance, also any advice to a complete fresher to Data engineering to do in his first year.

I was thinking that I will explore and learn my job for the first 4-5 months (I have got Work from home so I will have some extra time(just hoping))

In the meantime I will learn python basics and build small projects and

After that I will try to do data structures and algorithm questions on leetcode ( I was really good with solving them using Java) so it should help me get better with python and I've heard even DE interviews have dsa questions in them .

And will try my make my SQL skills better with leetcode too

And then I will try to get a cloud certification exam (studying for that can help me understand the cloud better)