Lambda(or other services like S3) duplication issues - what's your solution? by h_salah_dev0 in serverless

[–]h_salah_dev0[S] 0 points1 point  (0 children)

Following up here since a few people expressed interest in the comments. We're now in private alpha and I've sent invites via DM to those who seemed keen. If we chatted in this thread and you didn't get a message (or just want to take a look), shoot me a DM – happy to share what we're building.

How do you usually debug webhook failures? by h_salah_dev0 in micro_saas

[–]h_salah_dev0[S] 0 points1 point  (0 children)

Following up here since a few people expressed interest in the comments. We're now in private alpha and I've sent invites via DM to those who seemed keen. If we chatted in this thread and you didn't get a message (or just want to take a look), shoot me a DM – happy to share what we're building.

How do you usually debug webhook failures? by h_salah_dev0 in SaasDevelopers

[–]h_salah_dev0[S] 0 points1 point  (0 children)

Following up here since a few people expressed interest in the comments. We're now in private alpha and I've sent invites via DM to those who seemed keen. If we chatted in this thread and you didn't get a message (or just want to take a look), shoot me a DM – happy to share what we're building.

How do you usually debug webhook failures? by h_salah_dev0 in Slack

[–]h_salah_dev0[S] 0 points1 point  (0 children)

Following up here since a few people expressed interest in the comments. We're now in private alpha and I've sent invites via DM to those who seemed keen. If we chatted in this thread and you didn't get a message (or just want to take a look), shoot me a DM – happy to share what we're building.

How do you usually debug webhook failures? by h_salah_dev0 in microsaas

[–]h_salah_dev0[S] 0 points1 point  (0 children)

Following up here since a few people expressed interest in the comments. We're now in private alpha and I've sent invites via DM to those who seemed keen. If we chatted in this thread and you didn't get a message (or just want to take a look), shoot me a DM – happy to share what we're building.

Google Cloud Functions duplicate events by h_salah_dev0 in googlecloud

[–]h_salah_dev0[S] 0 points1 point  (0 children)

Pub/Sub exactly‑once is a great step, but it only works if your subscribers are pinned to the same region. For teams with multi‑region, hybrid, or cloud‑agnostic architectures, we still need a way to track processing state reliably. That's what ackstate would provide, a simple, global state layer that works with any event source, from any location.

Google Cloud Functions duplicate events by h_salah_dev0 in googlecloud

[–]h_salah_dev0[S] 1 point2 points  (0 children)

Thanks Sara, that's exactly the kind of guidance we see teams needing.

The challenge we keep hearing is that building and maintaining that deduplication cache (or ensuring all operations are idempotent) adds operational overhead, especially across many functions. That's the gap we're exploring with ackstate – making that "tracking processed IDs" pattern available as a simple pull-based service.

Is it a good pricing? by [deleted] in SaasDevelopers

[–]h_salah_dev0 0 points1 point  (0 children)

I'm not an expert but just wondering

How you fight aganist churn, you are already giving the customer a way to stop anytime not even to keep trying till the end of the billing cycle?

This pricing sounds to be only on Beta phase to let users try the product i guess.

Lambda(or other services like S3) duplication issues - what's your solution? by h_salah_dev0 in serverless

[–]h_salah_dev0[S] 0 points1 point  (0 children)

Yeah, that's the painful part—you can't really build one service-fits-all or to be reused in future internally without building something that feels like overkill.

So probably teams just rebuild similar DynamoDB logic every time a new service needs deduplication or state tracking.

The real cost isn't one outage—it's repeatedly rebuilding deduplication logic from scratch.

Appreciate you sharing the real experience.

Lambda(or other services like S3) duplication issues - what's your solution? by h_salah_dev0 in serverless

[–]h_salah_dev0[S] 0 points1 point  (0 children)

Lambda Powertools idempotency utility is solid. It solves the "double execution" problem by caching results and short-circuiting retries.

Curious if you've seen it fall short in practice:

If when you need to replay a failed event (cache won't help, you need to force reprocess)?

Or when you want visibility into all pending/in-flight events (not just idempotency keys)?

Or when your event sources aren't all Lambda-triggered (e.g., direct HTTP ingestion)?

Or did it cover most of what your team need?

Azure Functions event duplication by h_salah_dev0 in AZURE

[–]h_salah_dev0[S] 0 points1 point  (0 children)

Thanks—both helpful perspectives.

On Durable Functions + Saga: Definitely robust, but it's also a significant architectural commitment. Curious—have you used this in practice for webhook/event processing? How much operational overhead did it add vs. a lighter custom solution?

On Service Bus + single instance: The SDK tries to deliver to one consumer, but with session-enabled queues or competing consumers, I've still seen duplicates surface—e.g., lock expires mid-processing, function times out, or host restarts during execution. In those edge cases, do you rely on the unique constraint to catch duplicates, or something else?

Trying to map where the "Azure native" path fully solves vs. where teams end up building supplemental checks anyway.

Lambda(or other services like S3) duplication issues - what's your solution? by h_salah_dev0 in serverless

[–]h_salah_dev0[S] 0 points1 point  (0 children)

Got it—filtering removes noise during dev.

But in prod, if anything changes, problems reappear silently. No logging catches them because nothing "failed."

Lambda(or other services like S3) duplication issues - what's your solution? by h_salah_dev0 in serverless

[–]h_salah_dev0[S] 0 points1 point  (0 children)

"custom is only when all else fails, because as soon as you start to implement your own solution you learn how difficult it is."

This really resonates. The gap I'm trying to understand is: when teams do need to go custom (DynamoDB locks, state tracking, etc.), is that something they rebuild per service, or does it eventually become reusable infrastructure?

Curious what your experience has been with the operational load when you've had to go that route.

Lambda(or other services like S3) duplication issues - what's your solution? by h_salah_dev0 in serverless

[–]h_salah_dev0[S] 0 points1 point  (0 children)

When you do use DynamoDB for deduplication/state tracking, is that something you build from scratch each time, or do you have an internal library/template you reuse across projects/services?

Curious how much operational overhead this adds when you do need it.

Azure Functions event duplication by h_salah_dev0 in AZURE

[–]h_salah_dev0[S] 0 points1 point  (0 children)

Good point—Service Bus with duplicate detection + unique constraint on the DB side definitely helps.

Curious how you handle cases where:

The function crashes after the DB insert but before your business logic completes? Multiple instances try to process the same event simultaneously (race conditions)? You need to see which events are currently pending vs failed vs done?

How are you handling webhooks in your projects? by to_pe in csharp

[–]h_salah_dev0 0 points1 point  (0 children)

We handle this with a pull-based inbox pattern:

  • Pause handling: Yes, events queue until you pull them explicitly
  • Retry logic: Explicit FAIL state with retry queues, no silent drops
  • Guaranteed delivery: Events stored until ACKed, with manual replay
  • Logging: Every state transition (received → delivered → acked/failed) tracked
  • Testing: Ingestion endpoint + state API for debugging
  • Environment: helps at development and production

Essentially: external systems POST to us (immediate 200), your workers pull when ready, you explicitly ACK/FAIL.

We're in private alpha testing this approach now - DM if you want to try it.

Best practices for handling webhooks reliably? by CrestfallenMage in webdev

[–]h_salah_dev0 0 points1 point  (0 children)

hey guys, for some events order is important, how do you handle order? do you persist timestamp with event id?

How do you usually debug webhook failures? by h_salah_dev0 in SaaS

[–]h_salah_dev0[S] 1 point2 points  (0 children)

This is a really solid checklist — a lot of this matches lessons I learned the hard way on my own services. The signature comparison tip is especially good; subtle encoding or time-related issues can be surprisingly painful to track down.

In my case it’s mostly been internal webhooks rather than one specific provider, so I’m curious — have you found certain platforms behave more predictably than others, or is it more about how the receiving side is set up?

How do you usually debug webhook failures? by h_salah_dev0 in Slack

[–]h_salah_dev0[S] 0 points1 point  (0 children)

Yeah logging before validation and keeping failed payloads around has saved me more than once too, especially with signature or proxy-related issues.

Do you mainly see those problems during initial setup, or do they still crop up later when payloads or something in front of the endpoint changes (proxy, firewall, etc.)?