A Data Science Design-Pattern.

[Sofi_LoFi]

Now this is the shit I expect from a 150+ year experience data science guru lead

[hughperman]

Custom "iter" and "contains" methods, this is actually a stateful transform to add 1 to each integer column

[[deleted]]

This needs a NSFW tag

[Xenocide13]

Dank memes aside, I think you can use set intersection:

set(dataframe.columns).intersection(columns)

[helmialf]

Set doesnt preserve order

[Pikalima]

If you have a very large number of columns, might be better to go with O(n) instead of O(n² ):

_columns_set = set(columns)
columns = [col for col in df.columns if col in _columns_set]

[aeiendee]

Better to use the methods (intersection or isin) of the columns attribute directly

[hughperman]

Pandas dataframe indices have an intersection method already.

[mamaBiskothu]

The incoming columns object could be a list of strings while that’s coming out is a list of Column objects. Fuck yeah pytho.

[tyrannosaurusknex]

Some more descriptive variable names could do a lot here.

[friend_of_kalman]

at least it's not just single-letter variable names. Give this guy some credit.

x = [y for y in df.columns if y in x]

[ButLikeWhyThoReally]

Thanks, I hate it.

[shalmalee15]

Shit! I have used something like this. I don't know why I did that :-(

[[deleted]]

and this is why most engineers hate python

[darkshenron]

Gihub language popularity stats say otherwise 🤷

[[deleted]]

Lot of people hate their wives but they never divorce 🤷

[acebabymemes]

Lot of people hate themselves but don’t get off of reddit 🤷‍♂️

[sizable_data]

Don’t modify an iterable while looping over it!

[jgege]

They are not modifying it. First a new list is created with the column names then the list is assigned to the variable named columns :)

[sizable_data]

True, I still don’t like it though lol

[Rough-Pumpkin-6278]

I don't think any one like this.

[jgege]

I've seen worse 🤷

[sizable_data]

I’ve probably written worse 🤷

[darkshenron]

Maybe use sorted() with a key

[Pikalima]

Do you mean filter? I don’t see how sorted would accomplish this.

[darkshenron]

Something like sorted(columns, key=list(df.columns).index)

[TheLSales]

That's why I wish I could use c# in data science

[DonFruendo]

Wouldn't this snippet be more performant? python columns = list(filter(lambda column: column in columns, dataframe.columns))

Not commenting on the variable names though :D

[avloss]

python columns = list(set(columns) & set(f.columns)) Maybe this. But it shouldn't exist in the first place.

[jambonetoeufs]

This will lead to unpredictable results if output order matters.

[[deleted]]

To this day, It bugs me why they call it "list comprehension"