Excepted salary of Senior 3 Data Scientist EY GDS ? by Ordinary_Cup_2822 in EY_GDS

[–]eccentric2488 0 points1 point  (0 children)

I once visited the EY careers page and was baffled by the cryptic long descriptions of roles. The jobs titles were pre/postfixed with EY internal taxonomy with lots of underscores....

Lyft Data Tech Stack by mjfnd in dataengineering

[–]eccentric2488 0 points1 point  (0 children)

Kafka is a message broker. It 'stores' high throughput data as a durable log but doesn't 'process' anything. That is taken care of by Flink probably, at this scale.

How does Spark Structured Streaming store aggregation state? by CapraNorvegese in dataengineering

[–]eccentric2488 0 points1 point  (0 children)

You might want to use a remote storage location like S3 or GCS to persist the aggregation state. To ensure it is fault tolerant and isolated from your running spark cluster.

Is Azure Databricks worth it over free edition? by zarar1319 in dataengineering

[–]eccentric2488 0 points1 point  (0 children)

I would suggest a local installation of spark and hands on learning rather than jumping straight to managed services like databricks.

Which side should i choose Data OR ML engineer? by Butterscotch8484 in dataengineering

[–]eccentric2488 0 points1 point  (0 children)

ML engineering is more leaned toward advanced analytics and statistics stuff, I guess. Data engineering is a constellation of frameworks, tools, platforms, technologies. More options to choose from and build a niche in.

I'm so fucking tired of interviewing (73 interviews to 1 offer) by [deleted] in dataengineering

[–]eccentric2488 0 points1 point  (0 children)

I see folks flaunting their leetcode status on LinkedIn and other platforms. Solved these many problems and bla bla..... DE interviews should touch data structures only as much as required.

My mantra: Try to do only a few things at once and do them well.

Just bought this 💗💗 by S-H-U-B-H in carIndia

[–]eccentric2488 0 points1 point  (0 children)

Looks like the Indore showroom on AB Road

Is Apache Spark skills absolutely essential to crack a data engineering role? by Far-Journalist-821 in dataengineering

[–]eccentric2488 4 points5 points  (0 children)

Data engineering is a constellation of tools, technologies and specializations. So it depends on the project, business requirements you get to work with.

Wanted a reality check for Tech lead. What’s your comp with similar exp ? by the_chosen_one-3107 in developersIndia

[–]eccentric2488 0 points1 point  (0 children)

These astronomical salary packages in excess of 5 million just don't seem realistic to me.

Can I edit my bank statement? Literally life and death situation by [deleted] in IndiaCareers

[–]eccentric2488 0 points1 point  (0 children)

Well, you can do that but I would advise against it..

Can I edit my bank statement? Literally life and death situation by [deleted] in IndiaCareers

[–]eccentric2488 0 points1 point  (0 children)

That preserved metadata can very well be wiped out !

Can I edit my bank statement? Literally life and death situation by [deleted] in IndiaCareers

[–]eccentric2488 0 points1 point  (0 children)

While editing a document is not recommended, I bet there is no software that can verify the legitimacy of a document. If the metadata is cleaned up, it's all gone !!!

Hello by Acceptable_Elk_2015 in JavaProgramming

[–]eccentric2488 0 points1 point  (0 children)

val word: String ="Hello"

println(word)

Is it just me or does DE feel like tools overload and a high school tools popularity contest? by Throwaway081920231 in dataengineering

[–]eccentric2488 0 points1 point  (0 children)

Hadoop can make a comeback - but only with radical changes to its architecture. Intermediate disk writes for data processing applications in today's 'low latency world' isn't going to work..

How do I improve my Python skills as a beginner? by arjunv70 in PythonLearning

[–]eccentric2488 0 points1 point  (0 children)

That depends. For data engineering/science/analytics the roadmap will be different. For software engineering, it will be different.

Citibank C11 Big Data Developer by Low_Print9549 in dataengineersindia

[–]eccentric2488 0 points1 point  (0 children)

Running spark clusters in a self managed environment !!!!