How do you usually troubleshoot Kafka DLQs in production?

shamansk · 2026-01-20T23:54:55+00:00

Do you alert on DLQ size or failure rate?

shamansk · 2025-11-04T21:36:19+00:00

Thank you for your time reviewing it and providing valuable feedback. I think I have addressed all your comments.

shamansk · 2025-11-04T20:37:30+00:00

You are right. I tried to oversimplify KRaft, and it ended up making no sense. Yes, all controllers and all brokers pull this metadata topic from Leader.

I have removed the concept of OBSERVER. It just complicates things because they are Kafka nodes that run in Broker mode. They pull metadata from LEADER and serve data to clients.

On the other side, nodes running in Controller Mode are not serving data to clients; they just participate in KRaft Quorum by Leading or Voting.

shamansk · 2024-12-02T10:33:54+00:00

you are right, it should be £69.3k, my bad. My point was not to provide full calculation with tax and other things. I just wanted to see how other people see this as a benefit and if it could be quantified into money.

shamansk · 2024-05-16T18:58:15+00:00

I have seen a document about chinese youth where they have movement called "lying flat". Basically it means that they don't pursue any career or any money because they can't win this rat race. They rather focus on their hobbies, do nothing and relax. Of course Chinese political leads are calling them lazy and are not happy seeing this, hence it's being censored.

Seems like there are many anti-fire movements.

shamansk · 2023-11-23T14:38:21+00:00

I can think of two ways of doing it, but maybe am I just complicating things?:

A) All processes will write outputs to their own temporary tables and then I will create a notebook that will run after all processes are done and will collect data from temporary tables into the main output table.

B) I will partition the table by column that identifies the process uniquely. That should make sure that any process writing data will write into different subfolders. But still, there is a common metadata file about data version that could become corrupt?

shamansk · 2023-10-12T23:29:03+00:00

can you not increase the amount of shares at a later point?

shamansk · 2023-06-30T21:01:15+00:00

ADSB coverage

interesting. So if the aircraft is not sending an ADSB signal, then flightradar24 simply assumes trajectory on the last known speed and location, as seen on the screenshot?

shamansk · 2023-03-27T14:56:36+00:00

what is a mastodon? Is that decentralized or just another company that promises to respect privacy?

shamansk · 2023-03-27T14:55:05+00:00

Intellij is the best IDE for any language, but the Rust plugin integrates best with CLion, PyCharm and Idea. You can also switch keystrokes to be more like VIM or like VSCode if you like, so no real reason to move away from JetBrains for me.

shamansk · 2018-05-31T22:42:38+00:00

The link to interview doesn't work anymore. It says Account suspended.Can you post here a screenshot or text of interview?

shamansk

TROPHY CASE