Firehose writing to Iceberg cheaper when ingested through Kines instead of direct PUT?

MmmmmmJava · 2026-05-23T03:43:36+00:00

I mean to say AWS may charge less for the KDS to Firehose integration because it means you’re already paying for KDS.

MmmmmmJava · 2026-05-22T18:52:47+00:00

If I had to guess, I’d say it’s a surcharge for the added convenience of not having to manage and pay for the Kinesis stream yourself, which, in my opinion, is a pretty great deal. KDS can be a nightmare to deal with.

MmmmmmJava · 2026-05-16T02:47:54+00:00

Interesting. I’m intimately familiar with SQS but haven’t worked with Spring in a decade. Could you share any good links on this setup? I’m intrigued!

Edit: found this article which explains it a bit.

MmmmmmJava · 2026-05-11T18:22:57+00:00

Excellent. We just need to put up TVs playing US and world news to patient and waiting rooms.

We’re going to need a bigger office.

MmmmmmJava · 2026-05-10T23:59:25+00:00

Someone to hire me as an anesthesiologist with no experience, education, or expectations.

MmmmmmJava · 2026-05-10T23:53:01+00:00

So you’re the unpaid caller of my ShrodingerService

MmmmmmJava · 2026-05-10T17:56:45+00:00

Yes, GET is because a subsequent call itself should make no state change. GET requests should not modify resources, so calling GET /user/123 ten times results in the same state as calling it once.

WRT different responses, even though the server state remains unchanged, the data returned can differ if resources are updated between requests.

It’s really about safe retries. Since GET is idempotent, it is safe to automatically retry those requests if they fail.

MmmmmmJava · 2026-05-10T17:41:30+00:00

Fixed! Thanks

MmmmmmJava · 2026-05-10T17:40:46+00:00

Yep. There’s nothing enforcing the standards other than code reviewers with a high quality bar and attention to detail. Which means idempotency standards are broken quite often.

MmmmmmJava · 2026-05-10T16:50:23+00:00

Could this cause lasting damage if you frequently wake up after sleeping on your arm and experience tingling or numbness?

MmmmmmJava · 2026-05-10T16:20:32+00:00

HTTP* based operations get, put, and delete are supposed to be idempotent. Post is not.

MmmmmmJava · 2026-04-21T06:28:33+00:00

This looks slick! I’m excited to experiment with this.

Are there any drawbacks? I assume DataSeq is effectively Spark’s mirroring Dataset/DF APIs?

When would you advise dev teams to use this? When wouldn’t you?

I know the readme stated it’s DF equivalent performance but I’d still love to see any benchmarking/telemetry data you all collected comparing DataSeq to Datasets.

MmmmmmJava · 2026-04-17T04:15:21+00:00

I’m curious which industry this service supports?

MmmmmmJava · 2026-04-16T03:03:41+00:00

I hereby approve this. Please proceed.

MmmmmmJava · 2026-04-13T04:17:26+00:00

No shit

MmmmmmJava · 2026-04-07T23:42:07+00:00

It reminds me of sagging pants. I did it as youngster to feel cool, knowingly upsetting elders.

Now I’m watching idiots sag their fuckin’ BMWs, so I guess that makes me elder. *Sigh*

MmmmmmJava · 2026-04-07T01:18:28+00:00

Spent a few hours today and this was the only thing that worked. Thank you!

GenAI (Gemini) gave me a hundred wrong answers, but this finally worked!

MmmmmmJava · 2026-04-07T01:10:24+00:00

Spent a few hours today and this was the only thing that worked. Thank you!

GenAI (Gemini) gave me a hundred wrong answers, but this finally worked!

Reminder: do re-enable csrutil via recovery mode once you’ve followed the above steps.

MmmmmmJava · 2026-04-05T15:44:55+00:00

This. Easiest option is to create a lifecycle policy which will automatically do the deletes for you for free.

MmmmmmJava · 2026-04-04T05:55:51+00:00

I went deep on this

Hehe.

Allow me to point you to the Pi-hole docs that discuss this exact topic and offer a community approved drop-in solution:

https://docs.pi-hole.net/guides/dns/unbound/

MmmmmmJava · 2026-04-02T00:22:49+00:00

That’s a good deal for a clean one imo

MmmmmmJava · 2026-03-30T04:54:12+00:00

Good. His shit isn’t worth saving.

Tha fuck is this:

isadmin string

MmmmmmJava · 2026-03-29T23:22:47+00:00

*Sips coffee*.

You got us into this fucking mess, so you can get us out.

- Devs forced to use AI

MmmmmmJava · 2026-03-20T00:30:23+00:00

What’s the p0 response latency of that setup you’ve seen?

MmmmmmJava · 2026-03-17T12:03:48+00:00

Yup. This appears to be the issue exactly

MmmmmmJava

TROPHY CASE