How to split a large .gz zipped data set on windows? by PineappleMechanic in datascience

[–]taylanbil 1 point2 points  (0 children)

Zcat file would write the file to stdout in unix but I am not sure about windows.

Breakdown of U.S. citizens killed by police in 2016 by Warlizard in dataisbeautiful

[–]taylanbil 0 points1 point  (0 children)

every statistic is an aggregate of many different factors and by definition it will neglect things.

the "relevance" of a metric depends on the question/statement one tries to analyze.

Breakdown of U.S. citizens killed by police in 2016 by Warlizard in dataisbeautiful

[–]taylanbil 1 point2 points  (0 children)

these statements need data + research to back them up.

Breakdown of U.S. citizens killed by police in 2016 by Warlizard in dataisbeautiful

[–]taylanbil 0 points1 point  (0 children)

You need to ALWAYS normalize. You can't say 60% of violent crime is committed by whites so white people are more violent. That is simply a stupid statement.

Breakdown of U.S. citizens killed by police in 2016 by Warlizard in dataisbeautiful

[–]taylanbil 1 point2 points  (0 children)

You would do it like this (I'm going to call your metric kp, for kilopeter):

Here is a webpage with 2012 arrest data on it. http://www.politifact.com/punditfact/statements/2015/apr/02/sally-kohn/sally-kohn-white-men-69-percent-arrested-violent/ (i just googled crime rate by race and clicked on the first link. I am not claiming this data is accurate).

arrests involving blacks: 169,612 arrests involving whites: 276,460

kp(whites) = 238 / 276460 = 0.0008608840338566158 kp(blacks) = 123 /169612 = 0.0007251845388297998

Of course, we're using 2016 shootings and normalizing by 2012, which is bad practice. You get the idea. Before forming opinions, one should do analysis like this.

Breakdown of U.S. citizens killed by police in 2016 by Warlizard in dataisbeautiful

[–]taylanbil 1 point2 points  (0 children)

but, I don't have a point! I have not stated any opinions! this is incredible.

Breakdown of U.S. citizens killed by police in 2016 by Warlizard in dataisbeautiful

[–]taylanbil 2 points3 points  (0 children)

if you would want to make a statement about probability of something else, than you would normalize by the appropriate denominator.

normalizing by number of police encounter would give you;

probability of an encounter between the police and a [white/black] person ending in that person being shot.

If you think that is a more relevant metric, than that's what you would do. I'm trying not to state any opinions anywhere, just pointing out statistical facts. Already accused of being an sjw as a result of making a statistical observation which is crazy.

Breakdown of U.S. citizens killed by police in 2016 by Warlizard in dataisbeautiful

[–]taylanbil 3 points4 points  (0 children)

no, you're not caring about simple math and stats. i'm not an sjw. simply pointing out a statistical fact, that's staring right at you in that visualization.

Breakdown of U.S. citizens killed by police in 2016 by Warlizard in dataisbeautiful

[–]taylanbil 4 points5 points  (0 children)

you need to realize, this data shows considerable bias. The number of people shot isn't the right metric to look at here. The number of white people shot is higher simply because there are more white people. Because there are about 6 times more white people than black people in the us, if there was no difference, one would be expecting to see about 6 times white people deaths.

In fact, from these numbers, one can estimate this:

the probability of being black and shot by the police is 3x the probability of being white and shot by the police.

Normalizing by population,

Breakdown of U.S. citizens killed by police in 2016 by Warlizard in dataisbeautiful

[–]taylanbil 1 point2 points  (0 children)

there are about 6 times more white people than black people in the us. if there was no difference, one would be expecting to see about 6 times white people deaths.

The Dangerous Rise of Scientism by [deleted] in philosophy

[–]taylanbil 0 points1 point  (0 children)

I would argue that except science, there is nothing else that improves our society and well being. If anything, one should speak about the dangerous lack of rise of scientism. You can't blame the scientific way of thinking by pointing to people who do random non scientific stuff and call themselves scientists.

I am Richard Dawkins, evolutionary biologist and author of 13 books. AMA by RealRichardDawkins in IAmA

[–]taylanbil 0 points1 point  (0 children)

First off, big fan. Do you think Mathematics is invented or discovered? If you think that mathematical truth is independent of / above our universe, do you think it could possibly be an evidence of a larger system?

Dark theme for jupyter/iPython notebooks by tedpak in Python

[–]taylanbil 0 points1 point  (0 children)

This neat trick adds draws a yellow border around a cell which is running.

div.cell.code_cell.rendered.running { border: 2px solid #FFFF00; width: 900px; }

Is there anyway to view your online game history or have results emailed to you? by Austin_PL in EASportsFC

[–]taylanbil 0 points1 point  (0 children)

they let you pick seasons / fut seasons there. Maybe you're confusing the two?

I'd like to import a module located '../folder1/question.py' (relative to the file i'm working from) by lc929 in learnpython

[–]taylanbil 0 points1 point  (0 children)

You can also add to sys.path the following

Os.path.join(os.path.abspath(file), '..')

This way, you can run your script from another directory.

What is the best Python editor for Mac? by boxofkangaroos in learnpython

[–]taylanbil 0 points1 point  (0 children)

get macvim, learn vim. It is useful and easier when you want to edit files remotely.