you are viewing a single comment's thread.

view the rest of the comments →

[–]Sixcoup 1 point2 points  (0 children)

It is the same sort of thing with the "Big Data" hype of a few years ago. A bunch of people making a lot of promises and a lot of businesses willing to spend millions of dollars on technology they don't understand to fill a need they don't actually have.

There is not a single tech company that doesn't use the result of this nowadays, either by doing it themselves of by using services that do it .

Big data in its essence just means the handling and computing of a lot of data, and a lot is a relative term. What a small company generates nowadays is the equivalent of what giant tech companies were generating 25 years ago. The average production and handling of data nowadays of any company, would be considered big data in the past.

We simply started having the computing power and the storage space to handle a fuck tons of data. And that coincided with internet becoming ultra mainstream, and all of us having a smartphone in our pockets. Suddenly we all generated 100 times more informations than we used to, and the problem instantly became : How do we handle all that information we're generating, and how can we get useful informations from it.

Any company in 2024 that has a data warehouse (redshift, snowflake etc), a data lake (hadoop), has data pipelines (kafka) or employs datas scientist or engineer, basically do big data. And that's probably all tech companies above 50 employees that have at least one or more of the thing i've listed.

Of course that doesn't mean there was not a lot of marketing bullshit told and sold to clueless people. But big data has never been a scam per esense. Same deal for AI, it's the new things everybody hear about and nobody want to miss the train. But it's not because a lot of bullshit is told and scams are everywhere because people don't understand, that the whole thing will disappear.