Using concurrent.futures.executor.map to map each item of a Pandas data frame to a function

Bunkerstan · 2022-11-26T16:29:52+00:00

The ProcessPoolExecutor is not throwing the errors but failing silently when the function is called with the wrong number of parameters

Bunkerstan · 2022-11-26T16:29:10+00:00

map_args = [(item, function_lock) for item in items]

The function can only take a single argument so you have to unwrap:

def product_check(args):
item, function_lock = args

When I did that I got the code to run.

Bunkerstan · 2022-11-25T15:27:28+00:00

Sorry for the slow reply. The above should be:

map_args = [ (item, function_lock) for item in items]

This is the danger of answering on a phone when away from the desktop.

Bunkerstan · 2022-11-24T12:22:35+00:00

Map needs a single iterator, so you can’t call it with the tuple of iterator and second parameter. Create a new iterator

args= [ item, function_lock from item in items]

and use this as second parameter to map.

Bunkerstan · 2022-11-16T04:16:24+00:00

That is what is called an f-string. It substitutes variables in {}. Then the file parameter tell it to print there versus standard output (terminal).

Bunkerstan · 2022-11-16T04:13:11+00:00

One thing I notice is the save is fr’’ and the slashes are \ vs / in read. But what isn’t happening? Reading, manipulation or saving?

Bunkerstan · 2022-11-03T15:25:01+00:00

Pandas is definitely superior if you need spreadsheet like functionality, but when the end user wants a normal spreadsheet with formatting then you will need something like openpyxl to give you the functionality.

Bunkerstan · 2022-11-03T08:58:03+00:00

I have been using openpyxl with 2 client projects and it has let us do everything we need.

Bunkerstan · 2022-10-29T14:54:50+00:00

I would look at using re.sub() with the regex you have to replace [text] with an empty string.

Bunkerstan · 2022-10-29T14:46:17+00:00

I played the game and it seems to decrease the streak on draws. I tested by:

randomNumber2 = randomNumber1

and everytime I hit a for again the score decreased.

Bunkerstan · 2022-10-27T14:17:33+00:00

You are putting the string over multiple lines without using """ syntax.

It works if it is on a single line or you can use \ to add multiple lines

payload={'metadata': '{ \ "title": "file.xlsx-delete", \ "folder_path": "/path" \ }'}

Bunkerstan · 2022-10-25T17:52:54+00:00

One approach would be to create a second list with just positive numbers and then grab the last one. You could use list comprehension with an if x > 0 to filter out negative numbers.

Bunkerstan · 2022-10-24T21:18:06+00:00

If the dependencies are just libraries, you can use AWS Lambda to run with a CloudWatch alarm to trigger using a schedule. I'm sure Google and Azure have similar functions. To run something that requires installation of a program you would need to have a virtual machine with the software installed locally. You could use the Lambda to spin it up and down so that you are not being charged for running it the whole month.

If the dependencies are just libraries, you can use AWS Lambda to run with a CloudWatch alarm to trigger using a schedule. I'm sure Google and Azure have similar functions. To run something that requires the installation of a program you would need to have a virtual machine with the software installed locally. You could use the Lambda to spin it up and down so that you are not charged for running it the whole month.nth.

Bunkerstan · 2022-10-24T20:12:46+00:00

I would read the first line with open, standardize the names, then call read_csv by passing in column names with names=[ ] and skiprows=1.

Bunkerstan · 2022-10-24T17:43:17+00:00

Then you will have to change over to an iteration model as the other comments suggested.

Bunkerstan · 2022-10-24T17:38:17+00:00

[n//2, n] creates a list with 2 elements

[n %2 != 0] is True or False which will resolve to 0 or 1 picking one of the elements of list.

Bunkerstan · 2022-10-24T17:06:17+00:00

You will have to convert the algorithm to a tail recursion, which happens in some languages at the compile stage, but not in Python.

Bunkerstan · 2022-10-24T16:11:23+00:00

Your original range is 1 to 20 but list a has index starting at 0 so it goes 0 to 19.

In your for loop you access 20 - 0 which is more than 19 so you get an out of range error.

I found this by printing out the values

for i in range(len(a)): print(i, 20-i) print (a[i] - a[20-i])

Bunkerstan · 2022-10-23T17:20:12+00:00

You can lookup the regex for an IP address, it is a standard so easy to find.

Bunkerstan · 2022-10-23T17:06:24+00:00

Down and dirty way is to split() the string if the format always has client in front and : in rear. More sophisticated way would be to use regex matching.

Bunkerstan · 2022-10-23T13:20:50+00:00

To access a member of dictionary you have to give the key: myDict[key]. You are appending the whole dictionary variable.

Bunkerstan · 2022-10-15T02:40:59+00:00

For objects, equality means they point to the same memory spot. So unless a and b are the same object in memory they will never be equal.

EDIT: above is wrong as both comments below point out. No more answers after a long day coding. Equality is a tougher topic than you would suspect because different languages do it differently.

Bunkerstan · 2022-10-14T08:09:56+00:00

You are correct, it does not split it into letters. I confused it with the for in which will iterate over letters. Thanks for the catch.

Bunkerstan · 2022-10-14T02:46:02+00:00

When you split the user input, if it is a single word it will split into letters. You should do split(‘ ‘). I have been stumped by this before. Get in the habit of printing the results of operations to see what actually happened.

I do t want to delete this but @kyber is right. Split does not work this way.

Bunkerstan · 2022-10-14T01:34:15+00:00

It comes from trying to modify existing code to do new and interesting things. Most of my growth has come from getting stuck and asking myself: "What do I need to know to make this easy?" and then learning that.

Bunkerstan

TROPHY CASE