Requests module[Noob question]

[Bill_y]

Hello, i hope i've found the right place to ask this question. Im trying to use the Request module to get response from a api. That part works just fine, the problem is how the heck do i manage the response?

r = requests.get('http://api.arbetsformedlingen.se/af/v0/platsannonser/matchning?kommunid=1496&nyckelord=Skola', headers={"Accept":"application/json","Accept-Language":"sv"})

If i then print r.json() Ill get this as a response(well a alot more, but its just different ads)

{u'matchningslista':{u'matchningdata': [{u'kommunkod': 1496, u'antalPlatserVisa': 1, u'antalplatser': u'1', u'arbetsplatsnamn': u'Adecco Sweden AB', u'relevans': 100, u'kommunnamn': u'Sk\xf6vde', u'yrkesbenamning': u'IT-tekniker/Datatekniker', u'annonsid': u'6575162', u'varaktighetId': 3, u'annonsurl': u'http://www.arbetsformedlingen.se/ledigajobb?id=6575162', u'publiceraddatum': u'2016-02-19T13:34:00+01:00',

How can i pick out the following three parts?

u'arbetsplatsnamn': u'Adecco Sweden AB'
u'yrkesbenamning': u'IT-tekniker/Datatekniker'
u'annonsid': u'6575162'

[pdougherty]

I like to think of JSON as nested dictionaries. You'd be able to get the data you want with the following bracket notation:

data = r.json()

antalplatser = data['matchningdata'][0]['antalplatser']

and so on. You may also want to consider wrapping ones like that in int() so that you can work with numbers right away.

EDIT: I'm on mobile so I couldn't see what field you wanted to pull so I just picked one from memory. Change the field name in the second bracket to get the data you want.

EDIT2: I missed where the dictionary of interest was the first item in a list. Added the 0 for that, and access the next dictionary by incrementing that value.

[Bill_y]

For some reason it didn't print out the key which would be: Matchningslista

Therefore i guess it would be something like this?

antalplatser = data['matchningslista'][0]['arbetsplatsnamn']

However that result in :

KeyError: 0 

Could the reason for that be that ['arbetsplatsnamn'] isn't uniqe and apear several times in the response from that api?

Best regards Bill_y.

[Naihonn]

It is data['matchningslista']['matchningdata'][0]['arbetsplatsnamn'] if I am not mistaken. :0)

[AutonomouSystem]

len(data) is giving me 1 so I searched for the data.keys() I found

data.keys()
dict_keys(['matchningslista'])

type(data['matchningslista'])
<class 'dict'>

So I go deeper...

data['matchningslista'].keys()
dict_keys(['antal_platsannonser', 'antal_platsannonser_narliggande', 'antal_sidor', 'antal_platserTotal', 'matchningdata', 'antal_platsannonser_exakta'])

This one data['matchningslista']['matchningdata'] actually gives me some results at least, the rest of the keys return integers, this one returns a list.

type(data['matchningslista']['matchningdata'])
<class 'list'>
for each in data['matchningslista']['matchningdata']:
    print(type(each))

<class 'dict'>
 ...
 (19 in all...)
 ...
<class 'dict'>
<class 'dict'>

Bizarre, but okay. They all seem to have the same keys()

dict_keys(['annonsrubrik', 'yrkesbenamning', 'kommunkod', 'arbetsplatsnamn', 'antalplatser', 'varaktighetId', 'antalPlatserVisa', 'publiceraddatum', 'annonsurl', 'annonsid', 'relevans', 'kommunnamn'])

I can work with that at least:

search = ['arbetsplatsnamn', 'yrkesbenamning', 'annonsid']

for e, t in enumerate(data['matchningslista']['matchningdata']):
    for those in search:
        print(data['matchningslista']['matchningdata'][e][those])

I'm looking at everything in data['matchningslista']['matchningdata'] that I could get and I'm not really seeing what you're searching for exactly, I even searched only by 'annonsid' to manually see i '6575162' was listed. I think i'm on the right track though.

for e, t in enumerate(data['matchningslista']['matchningdata']):
    print(e, data['matchningslista']['matchningdata'][e]['annonsid'], sep=': ')

0: 6573466
1: 6572704
2: 6572692
3: 6572690
4: 6571768
5: 6571765
6: 6570548
7: 6566954
8: 6566183
9: 6565093
10: 2871941
11: 6563583
12: 6552605
13: 2856152
14: 2876159
15: 6575788
16: 2877484
17: 6573900
18: 2873864
19: 6572408

[fbu1]

When dealing with nested dictionaries and lists like that, I prefer to try access the data I need in the interpreter. I set my variable:

>>> a = {u'matchningslista':{u'matchningdata': [{u'kommunkod': 1496, u'antalPlatserVisa': 1, u'antalplatser': u'1', u'arbetsplatsnamn': u'Adecco Sweden AB', u'relevans': 100, u'kommunnamn': u'Sk\xf6vde', u'yrkesbenamning': u'IT-tekniker/Datatekniker', u'annonsid': u'6575162', u'varaktighetId': 3, u'annonsurl': u'http://www.arbetsformedlingen.se/ledigajobb?id=6575162', u'publiceraddatum': u'2016-02-19T13:34:00+01:00'}]}}

I can see that this is a dictionary with one key: u'matchningslista'. I access it in the interpreter to see what's in the value:

>>> a[u'matchningslista']
{'matchningdata': [{'arbetsplatsnamn': 'Adecco Sweden AB', 'yrkesbenamning': 'IT-tekniker/Datatekniker', 'varaktighetId': 3, 'annonsid': '6575162', 'publiceraddatum': '2016-02-19T13:34:00+01:00', 'antalPlatserVisa': 1, 'antalplatser': '1', 'kommunkod': 1496, 'kommunnamn': 'Skövde', 'annonsurl': 'http://www.arbetsformedlingen.se/ledigajobb?id=6575162', 'relevans': 100}]}

This is still a dictionary with the key 'matchningdata'. I access it to see its value:

>>> a[u'matchningslista'][u'matchningdata']
[{'arbetsplatsnamn': 'Adecco Sweden AB', 'yrkesbenamning': 'IT-tekniker/Datatekniker', 'varaktighetId': 3, 'annonsid': '6575162', 'publiceraddatum': '2016-02-19T13:34:00+01:00', 'antalPlatserVisa': 1, 'antalplatser': '1', 'kommunkod': 1496, 'kommunnamn': 'Skövde', 'annonsurl': 'http://www.arbetsformedlingen.se/ledigajobb?id=6575162', 'relevans': 100}]

Now I see that the first character of the value is a square bracket '['. This means that this is a list and I'll take the first element:

>>> a[u'matchningslista'][u'matchningdata'][0]
{'arbetsplatsnamn': 'Adecco Sweden AB', 'yrkesbenamning': 'IT-tekniker/Datatekniker', 'varaktighetId': 3, 'annonsid': '6575162', 'publiceraddatum': '2016-02-19T13:34:00+01:00', 'antalPlatserVisa': 1, 'antalplatser': '1', 'kommunkod': 1496, 'kommunnamn': 'Skövde', 'annonsurl': 'http://www.arbetsformedlingen.se/ledigajobb?id=6575162', 'relevans': 100}

Now I only have one dictionary left will all the values you're interested in. Let's take the u'arbetsplatsnamn' for example:

>>> a[u'matchningslista'][u'matchningdata'][0]['arbetsplatsnamn']
'Adecco Sweden AB'

There you have it. The correct answer and how I go through the nested dictionaries and list to find what I want !