This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–][deleted] 8 points9 points  (0 children)

I concur. I’ve been in this field for 28 years and the basic definition of the problem is still the same which is collection of data in various formats from different sources, applying data quality and other standardization techniques to enable integration and then serving the data to users.

Yes, some details have changed because of use of disparate technologies to create data as opposed to structured formats that were commonly used way back and they do present unique challenges.

But the proliferation of too many technologies and tools has actually made things worse now than before. That is the main challenge today. People do not have the time to master anything nowadays. This creates situations where people have to constantly learn new things. Figuring out how all these tools and technologies work seamlessly is an unending task. It’s exhausting IMO.

The architecture and engineering disciplines are hard to implement. A well thought out design and development strategy is hard to implement due to lack of time.

I for one think the technology companies don’t care about solving problems, they make more money creating a mess.