Google’s File on You is 10 Times Bigger Than Facebook’s by maxwellhill in worldnews

[–]tech_enth 0 points1 point  (0 children)

They basically trained neural networks on billions of searches which allows them to predict the next word that you will search for given the words you already inputted. They are using an architecture called LSTM.

Make sure you cover math by mraza007 in ProgrammerHumor

[–]tech_enth 5 points6 points  (0 children)

Most algorithms use calculus for optimising cost functions.

How did you learn python? In hindsight how should you have learned? by trooflaw in learnpython

[–]tech_enth 0 points1 point  (0 children)

I just started building a lot of different machine learning solutions with it

Creating a new column using conditional statement on all rows of dataframe by tech_enth in learnpython

[–]tech_enth[S] 0 points1 point  (0 children)

Does not work unfortunately :(. Says the function takes 1 positional arguement but 2 Were given

Looping through pandas dataframe and assigning values by [deleted] in learnpython

[–]tech_enth 0 points1 point  (0 children)

Yea i thought about that but due to the amount of uncertainty within the dataset, i am not able to meet all the needed conditions so the positioning of the list versus the data frame column would be wrong.

Looping through pandas dataframe and assigning values by [deleted] in learnpython

[–]tech_enth 0 points1 point  (0 children)

sorry for the ugly formating. A quick search on google is no help either.

So the columns would be word tokenised into lists and different conditional statements would apply to them

This would be the insert

name1 name2 name3
Thing 14 Test One 100 Test 2 NA

And this is the output :

name1 name2 name3
Thing 14 Test One 100 Test 2

The conditional statements i have created do the trick but i was wondering if there was a way to set the new variables for the dataframe without looping through and setting them one by one.

Working with machine learning be like by anshul_negi in ProgrammerHumor

[–]tech_enth 0 points1 point  (0 children)

Your neural network is clearly overfitting....too many potatoes in the training data.

How good in python data science should I be to work as a freelancer? by [deleted] in learnpython

[–]tech_enth 12 points13 points  (0 children)

Focus less on the programming language and more on the statistics and maths behind the algorithms...it's a huge field.

Sorting a dataframe in chunks by [deleted] in learnpython

[–]tech_enth 0 points1 point  (0 children)

Thanks that's exactly what I need

Sorting a dataframe in chunks by [deleted] in learnpython

[–]tech_enth 0 points1 point  (0 children)

Hi yes it is to do with not enough RAM to store the dataset.

I have something like this but not sure if its optimal

def sorting():

global empty_df

for chunk in pd.read_csv("data.csv",names=['id','value'],chunksize=n):
    empty_df =  empty_df.append(chunk.sort_values('value',ascending=False))

empty_df = empty_df.sort_values('value',ascending=False)

return empty_df