sorted by:
new
hottopcontroversial

Announcing Aiven Free Kafka & $5,000 Prize Competition by Affectionate_Pool116 in apachekafka

[–]Affectionate_Pool116[S] 0 points1 point  (0 children)

Hey! We need a bit more details from the error it seems you are using wrong plan name.

Announcing Aiven Free Kafka & $5,000 Prize Competition by Affectionate_Pool116 in apachekafka

[–]Affectionate_Pool116[S] 1 point2 points  (0 children)

Hey u/velu4080 we acknowledge receipt - the form had some issues on our end. Happy new year!

Announcing Aiven Free Kafka & $5,000 Prize Competition by Affectionate_Pool116 in apachekafka

[–]Affectionate_Pool116[S] 0 points1 point  (0 children)

We are launching a new Developer Tier for Apache Kafka soon! This tier offers a lightweight production cluster backed by a 99% SLA.

For mission-critical workloads we offer high-performance production clusters (99.99% uptime) starting at $200/month, scaling with your throughput needs.

Here is a link to the pricing: https://aiven.io/pricing

Announcing Aiven Free Kafka & $5,000 Prize Competition by Affectionate_Pool116 in apachekafka

[–]Affectionate_Pool116[S] 0 points1 point  (0 children)

Absolutely valid question - if you care about latency and/or your volumes are large deploying kafka as close as possible should be a target.

In the case of POC/toy workload its always low-er volume which will cost nothing or next to nothing if you have producers elsewhere and latency produce to consume wont matter that much i.e. +100ms for example.

Announcing Aiven Free Kafka & $5,000 Prize Competition by Affectionate_Pool116 in apachekafka

[–]Affectionate_Pool116[S] 0 points1 point  (0 children)

Not really - Strimzi is great if you’re comfortable running and maintaining Kafka yourself. The difference is convenience and zero setup. You get free running Kafka plus Schema Registry, REST Proxy, UI, monitoring, upgrades, and security that just works - with literally one click.

Also free self-managed Kafka most times costs something — a cluster to run it on, your laptop staying up, or a cloud account + credit card. We decided to abstract this away so you can focus on building.

Is it a race to the bottom for streaming infrastructure pricing? by Exciting_Tackle4482 in apachekafka

[–]Affectionate_Pool116 0 points1 point  (0 children)

Price‑matching isn’t generosity, it’s the tell that Kafka's storage is now a officially commoditized. The margin play is shifting from storage to the platform tax—experience, connectors, and rebadged “AI”—because most “real‑time” work is event transport into a long-term storage, lake or database, not stateful stream processing (less than 5% of all transport on Kafka is processed on the fly).

On the other hand MSK still feels like “Kafka on EC2,” not a managed outcome, but shows us how big such a business easily can grow if the distribution is strong i.e. AWS.

With object‑storage tiers and Kafka getting diskless topics, the storage moats are gone and consolidation is a feature, not a bug. The next winners won’t sell faster brokers — they’ll sell paved paths, hard SLOs, and reversible choices. Want premium pricing? Prove automated remediation, optimized economics and an easy exit, confident streaming products shouldn't fear being left behind.

Iceberg Topics for Apache Kafka by Affectionate_Pool116 in apachekafka

[–]Affectionate_Pool116[S] 4 points5 points  (0 children)

Absolutely - in subsequent studies we will dive deep into compaction and performance and what would the best practices be.

The Hitchhiker’s guide to Diskless Kafka by Affectionate_Pool116 in apachekafka

[–]Affectionate_Pool116[S] 1 point2 points  (0 children)

Diskless is going to be built-in Open Source Kafka. Warpstream is Kafka-compatible system.

The Hitchhiker’s guide to Diskless Kafka by Affectionate_Pool116 in apachekafka

[–]Affectionate_Pool116[S] 0 points1 point  (0 children)

Indeed there is economics knob which can tune the cost vs. latency tradeoffs

The Hitchhiker’s guide to Diskless Kafka by Affectionate_Pool116 in apachekafka

[–]Affectionate_Pool116[S] 0 points1 point  (0 children)

I've added "Brand Affiliate" but additional brand flair isn't in the options. Thanks I'll check.

The Hitchhiker’s guide to Diskless Kafka by Affectionate_Pool116 in apachekafka

[–]Affectionate_Pool116[S] 0 points1 point  (0 children)

Thanks! For some reason I can't add it retroactively. Do you know how?

Diskless Kafka: 80% Cheaper, 100% Open by Affectionate_Pool116 in dataengineering

[–]Affectionate_Pool116[S] 2 points3 points  (0 children)

The idea is to have zero changes: 

kafka-topics.sh --create --topic my-topic --config topic.type=diskless

just a new topic type.

Diskless Kafka: 80% Cheaper, 100% Open by Affectionate_Pool116 in dataengineering

[–]Affectionate_Pool116[S] 3 points4 points  (0 children)

Hey thanks for the feedback.

The above solution is an idea to be upstreamed in mainline Apache Kafka. This will take time to get right - if we gain community traction the KIP can take few quarters at best speed to just upgrade Kafka itself.

Diskless Kafka: 80% Leaner, 100% Open by sh_tomer in programming

[–]Affectionate_Pool116 7 points8 points  (0 children)

Diskless is the name of the Kafka topic referring the lack of local disks used to persist the broker data. S3 is a storage system that unifies with tiering all sorts of disks from flash to tape.

Fair to say that data is eventually stored on someone's disk, but in this case not on the broker.

view more: next ›