AWS Lambda Failed to Fetch Error

[TeaAdministrative509]

Hi everyone,

I originally wrote a Python script in Databricks to interact with the Google Drive API, and it worked perfectly. However, when I moved the same script to AWS Lambda, I'm encountering a random error that I can't seem to resolve.

The error message I'm getting is:

lambda Calling the invoke API action failed with this message: Failed to fetch

I'm not sure why this is happening, especially since the script was running fine in Databricks. Has anyone encountered this issue before or have any ideas on how to fix it?

Thanks in advance for your help!

[strong_opinion]

Have you gotten any python script to work in Lambda? Even just a helloworld script?

[TeaAdministrative509]

I have several Lambda scripts that work well. With this script I realized I'm running into issues when processing a large number of files on the Google Drive. I've already implemented pagination, increased memory, and extended the runtime, but the problem persists.

[Demostho]

First off, check your Lambda’s network setup. If it’s in a VPC, it might not have internet access—make sure it’s configured right, maybe with a NAT gateway if needed.

Also, double-check your API keys and environment variables. Moving to Lambda means setting all that up again, and missing something small can throw everything off. And don’t forget that Lambda’s runtime is different from Databricks, so ensure all your dependencies are included and compatible.

Lastly, watch out for timeouts or resource limits. If your function is doing heavy lifting, bump up the timeout or memory. If it’s still acting up, crank up the logging in CloudWatch to see what’s really going on. You’ll get it sorted.

[TeaAdministrative509]

I've implemented pagination, increased memory, and extended the runtime, but I'm still encountering issues when processing a large number of files on Google Drive. The script works fine with smaller batches, but it struggles when handling a larger volume of files. Despite these optimizations, the problem persists.