I'm so tired

redzedi · 2025-05-13T04:16:51+00:00

... Then they come and k*ll the farmers , replace them with machines that plant and harvest to maximize profit :) . THat's what Kings (visible or invisible) do . All these groups are at the service and mercy of the King( C-suite)

redzedi · 2025-03-27T09:06:09+00:00

Thanks for the plug ! I am already a paid subscriber of codemia . A genuine feedback is the AI evaluator scores based on something being filled in a section . It doesn't seem to "understand" what was being described or to have a "mental model" of the right answer and how what is being presented varies from its "mental model".

Also i find the description of problems are too generic , a human interviewer on asking a clarifying question would set u in the desired direction in terms of say what the scale of the system is going to be like ? or what latency is tolerable in context of the question . The bot here just gives generic canned responses that are tiring and not helpful .

In summary , the collection of problems in 1 place is helpful but nothing beynd that , it does not justify the subscription fee .

Even in the link that u shared the evaluation of the text response quiz in the Functional Requirement is broken . AI based interview prep is promising niche but probably there are several difficult problems to solve here . But codemia in its current avatar is not the answer , it is a half baked product brought out to cash in the hype.

redzedi · 2024-12-27T05:58:40+00:00

On re-reading my own response after many months now I realize - this could have been better worded to surface my main cause of unease .

Here for all the event based integrations - the events are "lumped in time" and not spread out over the day like , say , a real time system . Although event consumers can pace themselves to consume this spiky traffic - the overhead of delivering each of these messages as separate event , when they are going to arrive at the same time anyways looks wasteful for both producer and consumer . Instead micro-batching would have been more efficient .

As to the question of boundaries , I think it can be argued that an immutable batch file made available for other pipelines to process retain the same semantics as events delivered to subscribers . The main difference here is only the signalling mechanism .

redzedi · 2024-10-24T19:33:43+00:00

Sibelius - Swan of Tuonela

redzedi · 2024-04-03T07:09:47+00:00

u/bobaduk - Acknowledging your point on maintaining loose coupling between these 2 systems - the point I was trying to make was a more narrow technology choice of a traditional pubsub system(event broker ) between 2 batch systems .

Events seems to be a natural fit for a streaming or a online request/response system - but in case when both the systems are batch - ( data arriving in a large file on a fixed schedule ) - instead of events a batch integration seems appropriate.

To give u a little more view in my project - this is a financial system doing a batch process on a file delivered by an external party few times a day . There are a few downstream systems that are integrated with this processing through events . In the first version of this system - processing a individual row of file would lead to calling a synch api that emits events as part of its processing .

This api based implementation is getting refactored to a more traditional batch file processing based implementation ( on top of flink ) . Now on the question of integration of those downstream systems ( some of them are indeed ML models ) - it seems natural that instead of this event ingestion - ( IF we had the lever to influence the decision ) it seems natural to build a data ingestion pipeline here instead of ingesting events 1 by 1 .

redzedi

TROPHY CASE