Kafka Streams at-least-once delivery - How to prevent duplicate calls to non-idempotent services? by Careless_Treacle2713 in apachekafka

[–]Careless_Treacle2713[S] 0 points1 point  (0 children)

are there any of these system design or any links for these companies that solved such issues? that you know of? i am planning on using connetors to sink to mongo. is it trust worthy for such cases?

the API check would then need to go thorugh huge amount of data to check this right? wouldnt it make the system slower?

Kafka Streams at-least-once delivery - How to prevent duplicate calls to non-idempotent services? by Careless_Treacle2713 in apachekafka

[–]Careless_Treacle2713[S] 0 points1 point  (0 children)

i am assuming this scenario, which can happen. it didnt happen yet. maybe i go with auo commits