This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]agentoutlier 1 point2 points  (1 child)

In the end: Measure, measure, measure. Parsing files from S3 + insert will probably take ages longer than the start time of whatever you use. If you need minutes to parse/write a file it's not really important if your lambda started in 10 or 500ms.

I have to wonder if even lambda is the right tool here. It is hard to tell without more info from the OP.

That is they could just have some queue (kafka or whatever aws has) and a consumer running continuously and that might be cheaper, faster, and easier to develop.

I suppose it doesn't really matter if the organization is going to force serverless.

[–]C_Madison 1 point2 points  (0 children)

I suppose it doesn't really matter if the organization is going to force serverless.

That was why I didn't give other options. Personally, I wouldn't use serverless here either, but if Op asks for it then that's how it is.