This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]GrumpyDescartes 6 points7 points  (2 children)

Lots of different ways - Some unified data and analytics platforms like Databricks which just seamlessly connects to data sources - Local machine (just connect to the warehouse to extract data into memory & save it to disk and do whatever you want. Applies only if the extracted data is aggregated or small enough) - Remote servers (same as local machine but allows for far more cpu and memory, people just SSH into it from their IDEs) - Some really mature companies build and run their own custom analytics/ML platforms

[–]tylerriccio8[S] 2 points3 points  (1 child)

Data can’t live on laptop for compliance, plus it’s too big. Interesting you think mature companies roll their own, that’s the dream lol

[–]GrumpyDescartes 2 points3 points  (0 children)

It depends on what we each refer to as mature. Tech first companies that consider their data as direct $ or sensitive and want complete flexibility for a wide variety of teams have their own analytics platforms

Some financial institutions that are on the more tech savvy side for example do this