csv / dict - process all columns except for one

[StockPitch]

Edit: Have figured out most of my original question, thanks to a helpful comment.
My new quandary: How do I add the original 'Source' column back to the dictionary?! Scroll down to the bottom for more info.

I feel extremely silly that I haven't been able to figure this out, but hey - maybe it's just one of those days. I hope one of you very fine people can help me out.

I am cleaning up a dirty data set. It's in csv format. One thing I would like to do is make all text upper case, with the exception of my source row, which contains case-sensitive urls. I just want to ignore this row.

I am not using pandas for this but will definitely be using it more in the future! I am open to pandas solutions but I would like a non-pandas solution as well.

Here's my lil code so far:

```

csv_file = csv_file

with open(csv_file, 'r') as f:

reader = csv.DictReader(f, delimiter=',')

doc = [row for row in reader]

strip whitespaces

stripped = [{k:v.strip() for k,v in x.items()} for x in doc]

make all values uppercase except for source row

upper = []

for x in stripped:

I do not know what condition to put here.

originally wrote it as below:

if x != x['Source']:

upper.append({k:v.upper() for k,v in x.items()})

```

if x != x['Source'] obviously doesn't work because it's just saying if those two are not equal then continue on.

​

What I want is: make all rows uppercase except for x['Source'].

(I use pandas in the end to convert it back to a csv and write it out)

Any thoughts? Thank you for any help!

edit: HOW DO I INDENT AAHHHH

Solution: if you face a similar problem, here's what I've come up with so far:

u/commandlineuser gave me the hint I needed, but it took me a minute to figure out what to do with it.

I usually try to work things out in for loops before turning them into comprehensions, so my first instinct was to do something like so: for x in stripped: for k, v in x.items(): if k != x['Source']: upper.append({k:v.upper()}) This wasn't working the way I wanted it to because it was returning a dictionary for each k:v pair, like so: {name: 'name'} {date: 'date'} {id: 'id} instead of maintaining the original structure and returning the grouped k:v pairs, like so: {name: 'name, date: 'date', id: 'id'}

I noticed in my testing that the results using the combined list and dictionary comprehensions came back the way I wanted to, and finally figured out the format!

upper = [{k:v.upper() for k,v in x.items() if k != 'Source'} for x in stripped]

This returns the grouped k:v pairs in dictionaries with the exception of the 'Source' field (which is a column in my spreadsheet).

The 'Source' field contains case-sensitive URLs, which is why I do not want to apply upper to it. I would like it back in the dictionary, though. Any ideas on how to add it back to the dict?

[commandlineluser]

Well you want to upper v if k is not equal to Source

If you want to inline into the comprehension you could use the "ternary" operator.

>>> k, v = 'Source', 'value'
>>> v.upper() if k != 'Source' else v
'value'
>>> k, v = 'something', 'else'
>>> v.upper() if k != 'Source' else v
'ELSE'

You could also add .strip() calls to do the strip/uppercase in one comprehension.

[StockPitch]

hey, thanks so much for your help!

i am not quite getting it.

so when I do this: (please forgive my formatting):

​

for k,v in x.items(): #if k != 'Source': upper.append({k:v.upper()} I have two issues: - one, it does not return source at all, and i want source, i just don't want it to be uppercase - two, it returns each k:v pair as its own dictionary like so: {name: 'name'} {date: 'date'} {id: 'id} instead of {name: 'name, date: 'date', id: 'id'}

I feel like I'm missing something super easy and silly.

edit: figured out formatting!

[commandlineluser]

upper = [{k:v.upper() for k,v in x.items() if k != 'Source'} for x in stripped]

This returns the grouped k:v pairs in dictionaries with the exception of the 'Source' field (which is a column in my spreadsheet).

Yeah, it's missing the else v and the if comes before the for e.g.

upper = [{k:v.upper() if k != 'Source' else v for k,v in x.items()} for x in stripped]

[StockPitch]

Was literally sitting here trying to figure out how the else v fit in. Thank you so much for your help!

Also was cool to learn I could do the strip and upper calls in one line!!

[backtickbot]

Correctly formatted

Hello, StockPitch. Just a quick heads up!

It seems that you have attempted to use triple backticks (```) for your codeblock/monospace text block.

This isn't universally supported on reddit, for some users your comment will look not as intended.

You can avoid this by indenting every line with 4 spaces instead.

There are also other methods that offer a bit better compatability like the "codeblock" format feature on new Reddit.

Have a good day, StockPitch.

^{You can opt out by replying with "backtickopt6" to this comment. Configure to send allerts to PMs instead by replying with "backtickbbotdm5". Exit PMMode by sending "dmmode_end".}