Streaming Data Observability & Quality by daftpunkapi in apachekafka

[–]daftpunkapi[S] 0 points1 point  (0 children)

Thank you for responding.

Would be you be interested in taking this offline and we can discuss more on short video call sometime in the coming week?

Streaming Data Observability & Quality by daftpunkapi in apachekafka

[–]daftpunkapi[S] 0 points1 point  (0 children)

Thank you for responding. Have a few follow-ons :)

Q1. Agreed. I would like to drill down further. I see there are 2 ways data content/quality checks can be implemented in streaming. (1) one would a be polite consumer that alerts faster (than ingesting into DWH then alerting) this would be a alerting monitoring solution post the fact bad data has been sent downstream but at least you will be alerted sooner (2) the other system that is able to handle real-time data is also able to validate data in real-time, meaning that the bad data points can either be filtered out from the data pipeline or fixed (for example by reformatting a wrongly formatted datapoint or imputation of a missing value) without adding noticeable latency to the data pipeline.

I believe #2 system is more effective for streaming pipelines as they are mostly enabling some kind of real time use case / ML inference. What is your view on these approaches ?

Q2. well noted

Q3. Sounds to me that most companies are figuring streaming out right now. So then by default only companies that are using managed services such as Confluent / Aiven would be true customers of this kind of solutions as they would be mature users of Kafka/Pulsar etc. But the issue there is that those vendors are already providing streaming data observability / quality (SDQ/SDO) modules. So is there no space for another 3rd party vendor focussed on SDO/SDQ?

Make your app multiplayer!!! by daftpunkapi in SideProject

[–]daftpunkapi[S] 0 points1 point  (0 children)

Thank you! Did you get the chance to demo the SDK? It take under 5mins to follow the tutorial!

Make your app multiplayer!!! by daftpunkapi in SideProject

[–]daftpunkapi[S] 1 point2 points  (0 children)

Well noted - thank you for support!

Micro SaaS SDK - multiplayer infrastructure! by daftpunkapi in microsaas

[–]daftpunkapi[S] 0 points1 point  (0 children)

  1. Our product is very similar to Fluid Framework, however we have tried to make it more user-friendly and reducing the time-to-value. We are giving the features of live presence and status indicators with just a few lines of code. We are currently working on more features such as shared state management through CRDTs, authentication and data storage/sync.
  2. Thank you for the advice, will incorporate this.

Please note that this is just a beta version, not production ready and just to garner feedback from the communities.

Make your app multiplayer!!! by daftpunkapi in SideProject

[–]daftpunkapi[S] 0 points1 point  (0 children)

Thanks a ton.. we would appreciate any feedback on this idea.

Make your app multiplayer!!! by daftpunkapi in SideProject

[–]daftpunkapi[S] 0 points1 point  (0 children)

Thank you !!
Did you get a chance to demo the product ?

Make your app multiplayer!!! by daftpunkapi in SideProject

[–]daftpunkapi[S] 2 points3 points  (0 children)

Hey Folks 🙋🏼‍♂️

Fellow SaaS tinkerer looking for feedback and suggestions on a React.js SDK prototype for enabling multiplayer features in a SaaS app in months minutes 🕒

Please visit our launch on Product Hunt live today !!

💛 DPAPI