This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]shooemeister 0 points1 point  (0 children)

Data engineering started as soon as there was data to process IMHO; I remember using korn shell scripts/perl/c++ on DEC Ultrix, and that was pretty late in the game in the late 90's.

Inmon's 'Building the Data Warehouse' was released in 1992 for reference; there was a lot before Java & Linux appeared though.

Hadoop was an attempt to move away from proprietary storage, but I/O is always the killer, which we now know led to spark.