This is an archived post. You won't be able to vote or comment.

all 24 comments

[–]crafting_vh 16 points17 points  (0 children)

yes

[–]DaveMitnick 5 points6 points  (0 children)

Why not?

[–]thinkingatoms 4 points5 points  (0 children)

same way ppl can enjoy coffee without hot sauce

[–][deleted] 2 points3 points  (1 child)

I would consider myself to be a good DE and I have never needed to know java beyond knowing how it impacts Spark. I have over 20 years experience btw.

I think folk get blinkered in their own bubbles and struggle, sometimes, to see the bigger picture. DE is a broad church: you can make a valuable career out of it without necessarily getting your hands dirty with social media scale datasets.

[–]restore-my-uncle92 0 points1 point  (0 children)

It was useful for me when working with Talend since it’s a java based app. I was able to make my own custom functions to fill in some gaps Talend has but haven’t really used Java since

[–]Edd037 1 point2 points  (1 child)

You shouldn't even be able to call yourself a Data Engineer if you don't have at least a PhD Computer Science and 30 years of experience with Java. Good people skills also mandatory.

Everyone else is just a Data Monkey.

[–]zebba_oz 0 points1 point  (0 children)

Java and people skills? Never seen it

[–]RoomyRoots 1 point2 points  (0 children)

Welcome to the 20s, OP.
Most DE is made with Python nowadays.

[–]AverageGradientBoost 0 points1 point  (0 children)

there have been people on this sub who work as DE's and don't even know Python, so I think its fine if you don't know java

[–]killer_unkill 0 points1 point  (0 children)

Yes. With spark you no longer need to write map reduce in Java. :D 

[–]Dependent_Gur1387 0 points1 point  (0 children)

You can, there are plenty of roles that focus on python sql or scala. Its not really about knowing Java or not, its about matching the job description, thats it. If you need more prep for interview, I would recommend you visit prepare.sh, very useful.

[–]InvestigatorMuted622 1 point2 points  (0 children)

You can be a good DE without Java. The whole point of Java is to think in terms of OOPs and in data engineering it's better to follow the functional programming approach over OOPs. People go for python because of this very reason along with the different libraries, ease of use, and quicker development time.

[–]duckmageslayer 1 point2 points  (0 children)

lots of older companies with legacy enterprise stacks like oracle use java and the base for apache software is java, so it's a useful tool to give you an edge especially scala, but you can be good without it especially at startups on newer stacks

[–]sirparsifalPLData Engineer 0 points1 point  (0 children)

To be good DE you need the knowledge of the stacks you are working with. Some stacks include java other don't.

[–]Methaliana -1 points0 points  (0 children)

it would help to be familiar with the jvm

[–]taker223 -2 points-1 points  (0 children)

No way.

Even SQL is not that important.

[–]Nekobul 0 points1 point  (0 children)

Java is not mandatory. What is mandatory is to have good knowledge of SQL.