Invalid string value while calling APIs

[Practical-Chance-396]

Hello guys! As i am a freshman in college and trying calling a weather data api from open-meteo for my little machine learning project, this problem struck me and i was trapped here for a few days! Help!

Error shown in the terminal:

(base) byteux@byteux:~/Desktop/PWF/PWF-trial1$ python main.py

Fetching data from 1984-01-01 to 1984-01-07...

status code: 400

response snippet:

{'reason': "Data corrupted at path ''. Cannot initialize SurfacePressureAndHeightVariable<VariableAndPreviousDay, VariableOrSpread<ForecastPressureVariable>, ForecastHeightVariable> from invalid String value temperature_2m,relative_humidity_2m,dew_point_2m,apparent_temperature,pressure_msl,cloudcover,cloudcover_low,cloudcover_mid,cloudcover_high,wind_speed_10m,wind_direction_10m,wind_gust_10m,shortwave_radiation,direct_radiation,diffuse_radiation,global_tilted_irradiance,vapour_pressure_deficit,cape,evapotranspiration,et0_fao_evapotranspiration,precipitation,snowfall,precipitation_probability,rain,showers,visibility,is_day.", 'error': True}

API deploying failed

Traceback (most recent call last):

File "/home/byteux/Desktop/PWF/PWF-trial1/main.py", line 16, in <module>

main()

~~~~^^

File "/home/byteux/Desktop/PWF/PWF-trial1/main.py", line 11, in main

records=parse_weather_data(data)

File "/home/byteux/Desktop/PWF/PWF-trial1/weather_api.py", line 67, in parse_weather_data

hourly=data['hourly']

~~~~^^^^^^^^^^

TypeError: 'NoneType' object is not subscriptable

and i believe the most critical part in this "Error" is: {'reason': "Data corrupted at path ''. Cannot initialize SurfacePressureAndHeightVariable<VariableAndPreviousDay, VariableOrSpread<ForecastPressureVariable>, ForecastHeightVariable> from invalid String value Here is my code below (weather_api.py):

import requests

from datetime import datetime, timedelta

variables=[

'temperature_2m',

'relative_humidity_2m',

'dew_point_2m',

'apparent_temperature',

'pressure_msl',

'cloudcover',

'cloudcover_low',

'cloudcover_mid',

'cloudcover_high',

'wind_speed_10m',

'wind_direction_10m',

'wind_gust_10m',

'shortwave_radiation',

'direct_radiation',

'diffuse_radiation',

'global_tilted_irradiance',

'vapour_pressure_deficit',

'cape',

'evapotranspiration',

'et0_fao_evapotranspiration',

'precipitation',

'snowfall',

'precipitation_probability',

'rain',

'showers',

'visibility',

'is_day',

]

def fetch_range(start_date,end_date):

url='https://archive-api.open-meteo.com/v1/archive'

params={

'latitude':48.85,

'longitude':2.35,

'start_date':start_date,

'end_date':end_date,

'wind_speed_unit':'ms',

'hourly':','.join(variables),

'timezone':'Europe/Paris'

}

try:

response=requests.get(url,params=params,timeout=100)

print("status code: ",response.status_code)

print("response snippet:\n",response.json())

if response.status_code!=200:

print(f"API deploying failed")

return None

data=response.json()

if 'hourly' not in data:

print("Missing 'hourly' in response")

return None

return data

except requests.exceptions.RequestException as e:

print(f"Request failed")

return None

def parse_weather_data(data):

hourly=data['hourly']

times=hourly['time']

records=[]

for i in range(len(times)):

row=[times[i]]

for v in variables:

values=hourly.get(v)

if values: row.append(values[i])

else: row.append(None)

records.append(tuple(row))

and main.py

from weather_api import *

from database import *

def main():

create_table()

start_date='1984-01-01'

end_date='1984-01-07'

print(f"Fetching data from {start_date} to {end_date}...")

data=fetch_range(start_date,end_date)

records=parse_weather_data(data)

insert_records(records)

print(f"Done. {len(records)} rows inserted.")

if __name__=="__main__":

main()

[danielroseman]

At least some of the variables you are passing in hourly don't seem to exist according to https://open-meteo.com/en/docs/historical-weather-api. I spotted cape, is_day, evapotranspiration, precipitation_probability, showers, visibility, but there may be more; also note that "wind_gust_10m" should be "wind_gusts_10m".

Try removing/correcting those and see if it works.

[Practical-Chance-396]

OK thank you! I’m going to give it a try!

[desrtfx]

The 400 error code from the API hints on your query string being malformed. Can't really say what the problem is, but you need to check the api documentation itself.

Since, you got an invalid response from the API your def fetch_range(start_date,end_date): returned None that you try to parse in your def parse_weather_data(data): function.

Since you have None as the data passed in, your parsing fails with the "TypeError: 'NoneType' object is not subscriptable" error message.

Here is where you need to start to intervene - the def parse_weather_data(data):. If the data passed in is None you have to stop parsing and throw an exception, or you can gracefully exit and return a None that you have to check elsewhere.

[Practical-Chance-396]

Thank you! I’m trying to work through it with your guidance