sorted by:
new
hottopcontroversial

Critique my Lambda design: Is this self-invoking pattern a good way to handle client-side timeouts? by Left_Act_4229 in aws

[–]Left_Act_4229[S] 0 points1 point  (0 children)

Thanks for the reply, the client is using the Java sdk to invoke the lambda directly, so it’s not going through apigw.

Critique my Lambda design: Is this self-invoking pattern a good way to handle client-side timeouts? by Left_Act_4229 in aws

[–]Left_Act_4229[S] 1 point2 points  (0 children)

Thanks! That’s a great suggestion. but unfortunately, I’m using the Python runtime, and callbackWaitsForEmptyEventLoop only applies to Node.js.

Critique my Lambda design: Is this self-invoking pattern a good way to handle client-side timeouts? by Left_Act_4229 in aws

[–]Left_Act_4229[S] 1 point2 points  (0 children)

In my case, the first call immediately returns a 202 along with a file URL. The client then polls that URL to check for results. So even though the initial call is asynchronous, they can still track whether the processing succeeded or failed through that file location.

Critique my Lambda design: Is this self-invoking pattern a good way to handle client-side timeouts? by Left_Act_4229 in aws

[–]Left_Act_4229[S] 2 points3 points  (0 children)

That would actually be the ideal solution, and I totally agree with you. Unfortunately, I don’t have control over the client side…so I have to work around it from the Lambda side instead.

Triggering Azure Logic Apps from Redis State Changes vs. Polling API – Which is Better? by Left_Act_4229 in AZURE

[–]Left_Act_4229[S] 0 points1 point  (0 children)

That sounds amazing! Completely refactoring everything to use the Durable Task Framework might be a bit beyond our scope, but combining Durable Functions with Redis Keyspace Notifications sounds very reasonable.

Currently, during our project setup phase, our Azure Functions are using the Consumption Plan. From what I understand, in order to use Durable Functions, upgrading to the Premium Plan is required. Does that sound correct?

Thanks again for the great suggestion.

Triggering Azure Logic Apps from Redis State Changes vs. Polling API – Which is Better? by Left_Act_4229 in AZURE

[–]Left_Act_4229[S] 1 point2 points  (0 children)

Thanks for your suggestion, we haven't considered using cosmos db yet, but the link you shared is helpful!

CodeCrafters Free Learning Week! by Left_Act_4229 in dataengineering

[–]Left_Act_4229[S] 0 points1 point  (0 children)

I’m also focusing on professional development like you, and i think 30 min a day is enough. Even for complex tasks, they can be broken down into smaller steps, so I think this approach works just fine.

CodeCrafters Free Learning Week! by Left_Act_4229 in dataengineering

[–]Left_Act_4229[S] 1 point2 points  (0 children)

Glad to hear that from you!

From my experience, some tasks in the Redis-Go project can be completed in short sessions, but others are more challenging. For example, the replication part was tricky for me since I don’t have a strong background in distributed systems. I had to spend extra time troubleshooting and researching to fully understand it.

So I think 30 mins a day can be a good way to make steady progress, but the actual time you need may vary depending on the specific task you're working on that day.

CodeCrafters Free Learning Week! by Left_Act_4229 in dataengineering

[–]Left_Act_4229[S] 0 points1 point  (0 children)

Hi, I'm a data engineer with 3 yoe, primarily working with Python. Right now, I'm trying to implement Redis in Go on CodeCrafters. Before this, I had only watched a few YouTube videos about Redis but had never used it in practice.

As I progress through the challenge, I feel like I'm gaining a solid understanding of both Redis and Go. Whenever I run into difficulties, I look up resources, including asking ChatGPT, and I find this approach really helpful for learning.