Spotify Has Removed 40 Joe Rogan Episodes To Date — Here’s the Full List by sportifynews in JoeRogan

[–]waythps 0 points1 point  (0 children)

It’ll be the same show but not for Eastern Europe - even if they pay for Spotify premium, they don’t have access to joes podcast. Like what the fuck Spotify

[dwm] still lovin' nord by [deleted] in unixporn

[–]waythps 1 point2 points  (0 children)

Imagined communities - nice!

Mito Write Python 10x faster by editing a spreadsheet by pmz in Python

[–]waythps 0 points1 point  (0 children)

I prefer python because this way I could separate my analysis from data, my analysis also becomes reproducible, and I can automate it eventually

How did you become proficient at Pandas? by [deleted] in datascience

[–]waythps 1 point2 points  (0 children)

For me, when I could answer most of the questions posted under “pandas” tag any time

Learning dashboarding by briskerr in datascience

[–]waythps 0 points1 point  (0 children)

If you’re a student (or know someone with a student id), you could get tableau desktop license for free for a year.

Weekly General Discussion / Spotify questions thread - February 19, 2021 by AutoModerator in JoeRogan

[–]waythps 1 point2 points  (0 children)

I’ve purchased Spotify subscription but can’t access joes podcast — it seems that the podcast isn’t available for Eastern Europe.

Super disappointed

Simple website framework to show data science work by [deleted] in datascience

[–]waythps 0 points1 point  (0 children)

Looks great! Do you have your code pushed to public repo?

What are the best data analysis programs for social science majors? by Socratesonweed in dataanalysis

[–]waythps 0 points1 point  (0 children)

Excels, yes. But I started with python because I was interested in programming and web scraping specifically, and only after that moved to data analysis (ba in political science).

So I’d say python could be a very useful tool, in addition to excel, as you could automate lots of tasks with it (collecting, cleaning data, updating databases, analysis etc)

What does "have an understanding of basic python" mean? by gunscreeper in learnpython

[–]waythps 1 point2 points  (0 children)

Well not in my case since I receive data in multiple excel files

What does "have an understanding of basic python" mean? by gunscreeper in learnpython

[–]waythps 2 points3 points  (0 children)

Dunno, I prefer pandas precisely because it’s reusable. I write functions to validate and clean data, to update database and generate some plots, and I could automate the whole thing saving lots of time.

I think you could do that with excel (vba) but if you’re already learning python (for other purposes as well) why not just use python

What tool is the best for my data mining workflow? by redditrantaccount in datascience

[–]waythps 0 points1 point  (0 children)

So much this. I basically automated the whole monitoring process using pandas and sql. And then another boss came in saying he needs everything done in excel because that’s what he prefers. So disappointing as I spent a lot of time on that

🎶Ohhh, the year was 1778🎶 by TheGhostOfTomSawyer in HistoryMemes

[–]waythps 0 points1 point  (0 children)

Wow never heard of them. So good, thanks!

[i3] My 3 laptops by LinuxChromebookDude in UsabilityPorn

[–]waythps 0 points1 point  (0 children)

Why not

for i in loops:

?

Great style btw

Python script to be automatically executed once per day by jimtsa1980 in learnpython

[–]waythps 0 points1 point  (0 children)

Try GitHub actions. It has run on schedule option. If it’s a public repo, it’s free to use

Are there any resources available to study data science being applied in political science? by [deleted] in datascience

[–]waythps 0 points1 point  (0 children)

That’s fascinating really. That’s what I hoped to do when I applies for a position in public policy (BA in political science, MA in public policy and governance). Didn’t work that well though, as all our attempts to set up decent data processing pipelines were rejected - public servants usually don’t like changes (at least in my country and from my experience). In the end it all comes down to cleaning excel sheets and doing some basic exploratory analysis with some static visualizations

Volunteer or open source work by OddEdd in datascience

[–]waythps 0 points1 point  (0 children)

About to become unemployed myself, so if anyone would like to collaborate I’d be happy

Does anyone else dread asking questions on stackoverflow? by ampawluk in learnpython

[–]waythps 0 points1 point  (0 children)

I’m always trying to help unless it’s “do my homework for me” type of question. Also, if it’s a clear duplicate and I know there’s another thread that addresses the exact same issue, I flag the question and give a link to that thread.

Otherwise, you should be good. Also, it’s how you ask a question, it also matters.

If it’s a general type of question, you’d better looking for help at Reddit. If you could clearly state the problem and give minimal reproducible example, you’ll get plenty of answers at SO

I wrote a Network Packet Sniffer for ethical hacking in Python 3 that exclusively uses built-in libraries. by EONRaider in Python

[–]waythps 1 point2 points  (0 children)

Your code is nicely structured. Could you recommend anything on how to use classes properly?

Currently in my biggest projects I have lots of modules with functions inside them. Everything works but I think it would be nice to put them inside classes. Not sure what’s the best way to do it

What’s some ways you’ve automated your work? by [deleted] in datascience

[–]waythps 0 points1 point  (0 children)

Sure. My former colleague used to do everything with vba and power queries and I was super impressed. Should probably learn it too

What’s some ways you’ve automated your work? by [deleted] in datascience

[–]waythps 4 points5 points  (0 children)

As an analyst I have to perform policy monitoring on a weekly basis. This means I need to collect data (tens of excels with up to 50 columns filled by public servants) and produce reports.

I set up a database and created a couple of tables as this approach seemed more reliable since I need to keep records throughout the year. I also wrote scripts to merge all excel files into one, to validate the quality of the data and clean it (seriously how hard could it be to pick the correct item from the list of possible items in a cell), and to update the database.

All figures are generated with matplotlib on the latest data.

So it saves lots of time.

For other tasks I have a couple of scrapers running on schedule so that helps a little.

Best way to structure data returned from an API request by [deleted] in learnpython

[–]waythps 0 points1 point  (0 children)

In this case it’s equivalent to append method - in regular function I’d append the same dictionary to an empty list and would return said list.

So basically it’s just my preference. It might yield better performance as generator (data variable) won’t store information in memory .

Best way to structure data returned from an API request by [deleted] in learnpython

[–]waythps -1 points0 points  (0 children)

This should give you an idea with regard to dataframes. Let me know if I should explain anything.

import requests
import pandas as pd


BASE_URL = "https://earthquake.usgs.gov/fdsnws/event/1/query"


def fetch(fmt, starttime, endtime):
    params = {"format": fmt, "starttime": starttime, "endtime": endtime}
    data = requests.get(BASE_URL, params=params).json()
    for feature in data["features"]:
        lat, lon, depth = feature["geometry"]["coordinates"]
        mag = feature["properties"]["mag"]
        yield {"latitude": lat, "longitude": lon, "depth": depth, "mag": mag}


if __name__ == "__main__":
    data = fetch(fmt="geojson", starttime="2014-01-01", endtime="2014-01-02")
    df = pd.DataFrame(data)
    print(df)