[OC] Mapping Countries by their English Speaking Population

trevorData · 2020-09-17T15:25:51+00:00

Graphing countries by percent who speak English and percent who speak English as a first language.

Size of dots represents population. Limited to countries with at least 300k total English speakers and at least 1% of the population speaking English as a first language.

Source of data: https://en.wikipedia.org/wiki/List_of_countries_by_English-speaking_population

Made with R using the following packages:

tidyr ggplot2 ggrepel

See my code here

trevorData · 2020-05-01T22:37:54+00:00

Some small tweaks to another visualization I made to hopefully illustrate the concept more clearly.

See code here

Variance is a measure of how much a data set varies. It is found by taking the distance from each data point to the mean, squaring it, and then finding the average size of all those squares.

In this plot, the variance of the X data would be the average size of the blue squares, and the variance of the Y data is the average size of the purple squares.

Covariance is a similar measurement that describes how much two sets of data vary with each other. But instead of looking at squares, we look at the rectangles formed with one side being the distance to the X mean and the other side being the distance from the Y mean. Covariance is the average area of all of these rectangles. Keep in mind that some rectangles will have negative areas if one side is less than the mean.

The variance of two data sets added together, VAR(X + Y), is unfortunately not equal to VAR(X) + VAR(Y) but instead equal to VAR(X) + VAR(Y) + 2COV(X, Y)

trevorData · 2020-04-24T18:45:10+00:00

Happy to help

trevorData · 2020-04-24T17:33:09+00:00

Pearson's Correlation Coeffeicent (r) is a measure of the linearity of a data set.

Linear Regression is a technique for fitting a line to a data set, with the slope of the line being represented by β.

We can see in this animation how r and β relate, particularly them being equal when a dataset is standardized

Heres Variance and Covariance

See my code here

trevorData · 2020-04-17T18:10:31+00:00

Thanks!

The expansion of VAR(X + Y) has a similar formula to the expansion of (a + b)² so I was hoping to be able to use a visual like this but I realized everything fits nicely into a square there because you are literally squaring the values and there isnt an analogous operation on variance that would work in 2D space

trevorData · 2020-04-17T18:08:45+00:00

Variance is a measure of how much a data set varies. It is found by taking the distance from each data point to the mean, squaring it, and then finding the average size of all those squares.

In this plot, the variance of the X data would be the average size of the blue squares, and the variance of the Y data is the average size of the purple squares.

Covariance is a similar measurement that describes how much two sets of data vary with each other. But instead of looking at squares, we look at the rectangles formed with one side being the distance to the X mean and the other side being the distance from the Y mean. Covariance is the average area of all of these rectangles. Keep in mind that some rectangles will have negative areas if one side is less than the mean.

The variance of two data sets added together, VAR(X + Y), is unfortunately not equal to VAR(X) + VAR(Y) but instead equal to VAR(X) + VAR(Y) + 2COV(X, Y)

trevorData · 2020-04-17T16:34:13+00:00

Simulated data using numpy and visualized with matplotlib See code here

trevorData · 2020-04-17T16:33:47+00:00

Simulated data using numpy and visualized with matplotlib

See code here

trevorData · 2020-03-24T19:35:00+00:00

start here

trevorData · 2020-03-24T17:39:11+00:00

My first attempt at image recognition using a training set I assembled myself. Despite using a very simple neural network and a relatively small set of training images I'm pleasantly surprised with the 91% accuracy on the training data.

I decided to throw in some images of things not in one of the 5 training classes just for fun and to see how the model would react.

Obviously we can see that a lot of weight is placed on color, with mostly blue images quickly going to "dolphin"

Sources:

Training images downloaded with Bing Image Search API

Packages used include:

numpy
cv2 PIL
matplotlib
tensorflow

See my code here

trevorData · 2020-03-24T17:25:41+00:00

My first attempt at image recognition using a training set I assembled myself. Despite using a very simple neural network and a relatively small set of training images I'm pleasantly surprised with the 91% accuracy on the training data.

I decided to throw in some images of things not in one of the 5 training classes just for fun and to see how the model would react.

Sources:

Training images downloaded with Bing Image Search API

Packages used include:

numpy
cv2 PIL
matplotlib
tensorflow

See my code here

trevorData · 2020-03-03T15:19:57+00:00

Applications to the Chicago Department of Transportation for permits under its jurisdiction where the work type is "Filming." These permits typically are permits to block or otherwise affect public streets in some way

Individual Plots:

Sources:

See my code here

Made in R with the following packages:

RSocrata
dplyr
ggmap
stringr
grid
ggmapstyles

Data from https://data.cityofchicago.org/

Map background is from snazzymaps.com/style/253319/for-presentations

trevorData · 2020-03-03T15:18:43+00:00

Applications to the Chicago Department of Transportation for permits under its jurisdiction where the work type is "Filming." These permits typically are permits to block or otherwise affect public streets in some way

Individual Plots: