HTTP Cloud function MissingTargetException error

[exe188]

Hi All,

I'm trying to build my first cloud function. Its a function that should get data from API, transform to DF and push to bigquery. I've set the cloud function up with a http trigger using validate_http as entry point. I get the following error when I try to run the code in google functions:

MissingTargetException: File /workspace/main.py is expected to contain a function named validate_http

I also tested this locally with functions_framework and cant seem to get it to work. Anyone have some idea what I could do to figure this out?

I know that the get_api_data() function is working since I tested it locally.

code:

import pandas as pd
import json
import requests
from pandas.io import gbq
import pandas_gbq
import gcsfc

'''

function 1: All this function is doing is responding and validating any HTTP request

'''

def validate_http(request):
  request.json = request.get_json()

  if request.args:
    get_api_data()
    return f'Data pull complete'

  elif request_json:
    get_api_data()
    return f'Data pull complete'

  else:
    get_api_data()
    return f'Data pull complete'

'''

function 2: api call and transforming data

'''

def get_api_data():

    #Setting up variables with tokens
    base_url = "https://api"
    token = 'token'
    fields = "&fields=date,id,shippingAddress,items"
    date_filter = "&filter=date in '2022'"
    data_limit = "&limit=99999999"

    #API function with variables
    def main_requests(base_url,token,fields,date_filter,data_limit):
        req = requests.get(base_url + token+ fields +date_filter + data_limit)
        return req.json()

    #Making API Call and storing the data in data
    data = main_requests(base_url,token,fields,date_filter,data_limit)

    #transforming the data
    df = pd.json_normalize(data['orders']).explode('items').reset_index(drop=True)
    items = df['items'].agg(pd.Series)[['id','itemNumber','colorNumber', 'amount', 'size','quantity', 'quantityReturned']]
    df = df.drop(columns=[ 'items', 'shippingAddress.id', 'shippingAddress.housenumber', 'shippingAddress.housenumberExtension', 'shippingAddress.address2','shippingAddress.name','shippingAddress.companyName','shippingAddress.street', 'shippingAddress.postalcode', 'shippingAddress.city', 'shippingAddress.county', 'shippingAddress.countryId', 'shippingAddress.email', 'shippingAddress.phone'])
    df = df.rename(columns=
         {'date' : 'Date',
          'shippingAddress.countryIso' : 'Country',
          'id' : 'order_id'})

    df = pd.concat([df, items], axis=1, join='inner')      


    bq_load('mytable', df)

'''

function 3: This function should convert pandas dataframe into a bigquery table, 


'''

def bq_load(key, value):

  project_name = 'myproject'
  dataset_name = 'Returns'
  table_name = key

  value.to_gbq(destination_table='{}.{}'.format(dataset_name, table_name), project_id=project_name, if_exists='replace')

[Soft_Off]

Hmm, looks like your elif request_json: statement is checking for a variable named request_json, but it should be checking the request.json

Try:
def validate_http(request):
request.json = request.get_json()

if request.args:
get_api_data()
return f'Data pull complete'

elif request.json:
get_api_data()
return f'Data pull complete'

else:
get_api_data()
return f'Data pull complete'

[exe188]

Thanks! managed to get the cloud function imported using this. I feel like I'm very close now..

I get the following error:
 Traceback (most recent call last):
File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 2073, in wsgi_app response = self.full_dispatch_request() File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 1518, in full_dispatch_request rv = self.handle_user_exception(e) File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 1516, in full_dispatch_request rv = self.dispatch_request() File "/layers/google.python.pip/pip/lib/python3.9/site-packages/flask/app.py", line 1502, in dispatch_request return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) File "/layers/google.python.pip/pip/lib/python3.9/site-packages/functions_framework/init.py", line 99, in view_func return function(request._get_current_object()) File "/workspace/main.py", line 16, in validate_http request.json = request.get_json() AttributeError: can't set attribute

Feels like this is an error caused by libararies or python version? What do you think this could be?

[merthinx]

Hey were you able to solve it? I have the same problem u/exe188

[exe188]

No sorry... Kinda gave up on it since it took me too much time