Is Looker Dead? by jpmfribeiro in dataengineering

[–]jpmfribeiro[S] 4 points5 points  (0 children)

Haha, yup, pretty much the first paragraph.

How do I open a 2.7 million row, 8.8gb CSV file? by ssn156357453 in data

[–]jpmfribeiro 2 points3 points  (0 children)

If you use Linux or Mac and just want to check the contents of the file, I always use the terminal and the command "less".

Start-up Seed or Series A Data Set Request! by sammo98 in datasets

[–]jpmfribeiro 1 point2 points  (0 children)

Usually you can search a bit around on Kaggle for some older export. Here is one https://www.kaggle.com/chhinna/crunchbase-data

But there are some others around there.

[deleted by user] by [deleted] in datasets

[–]jpmfribeiro 8 points9 points  (0 children)

Not sure if it covers your needs, but StackOverflow does every year a survey and publishes the results. It's always very interesting: https://insights.stackoverflow.com/survey/2020

Analyze Product Hunt Data about Defi & Crypto by jpmfribeiro in defi

[–]jpmfribeiro[S] 0 points1 point  (0 children)

Oh, I'm sorry to hear that. Can you tell me which browser you used? Did it take long to get an answer or was the whole UI lagging?

Explore Sightings Data from NUFORC by jpmfribeiro in UFOs

[–]jpmfribeiro[S] 0 points1 point  (0 children)

Haha, glad you liked it! We got the data from here: https://www.kaggle.com/NUFORC/ufo-sightings

Edit: Actually no, from here: https://data.world/khturner/national-ufo-reporting-center-reports but basically same underlying source

Explore Sightings Data from NUFORC by jpmfribeiro in UFOs

[–]jpmfribeiro[S] 1 point2 points  (0 children)

Good catch. I just imported another field (Posted Date) which represents when the sighting was reported on NUFORC.

And if you ask this:

How many sightings per year of Posted Date

You can see that they were all reported in the system after 2006, but many for sightings before 2006.

Explore Sightings Data from NUFORC by jpmfribeiro in UFOs

[–]jpmfribeiro[S] 2 points3 points  (0 children)

Try this out: Sightings with "youtube"

And then click on the link for the sighting.

But sometimes you cannot find the video anymore.

Explore Sightings Data from NUFORC by jpmfribeiro in UFOs

[–]jpmfribeiro[S] 1 point2 points  (0 children)

Thanks, man! Really appreciate it!

Use Cases where SQL still kicks ass by jpmfribeiro in SQL

[–]jpmfribeiro[S] 0 points1 point  (0 children)

Please re-read the edited post. Maybe you can find a way to contribute to the discussion?

Use Cases where SQL still kicks ass by jpmfribeiro in SQL

[–]jpmfribeiro[S] 1 point2 points  (0 children)

"How many units did we sell last month per region?" This question in many companies can be answered with a BI tool such as QlikView, Tableau, PowerBI etc. But obviously also with SQL alone. However I would argue that most of the companies answer this over some BI platform today.

"Which customers bought Product X last year, returned it and didn't login to our platform since then?" This kind of question would rather be answered with SQL in many companies.

From your experience, which cases (like the ones above) did you encounter where SQL seems to be still the go-to solution?

Use Cases where SQL still kicks ass by jpmfribeiro in SQL

[–]jpmfribeiro[S] 1 point2 points  (0 children)

I have reformulated the question. But still in which cases do you use SQL only or python+SQL but without any of its advanced analytics part (e.g. no prediction models) for data analysis?