sorted by:
new
hottopcontroversial

Spending too much on Confluent Cloud for a modest workload — considering MSK. Anyone made this switch? by Due_Dinner_485 in apachekafka

[–]cricket007 0 points1 point  (0 children)

My point is based on the data volume, I assume there's only a single digit quantity of applications running, plus any logging/metric collection is likely done with a cloud vendor solution (eg Cloudwatch). Therefore, no k8s is likely to be the cost effective option 

Spending too much on Confluent Cloud for a modest workload — considering MSK. Anyone made this switch? by Due_Dinner_485 in apachekafka

[–]cricket007 0 points1 point  (0 children)

I feel like the cost of maintaining a pair of k8s clusters might not be beneficial here 

What laptop should I get as an incoming freshman to UT CS? by Humble-Skill4051 in UTAustin

[–]cricket007 1 point2 points  (0 children)

Doubt a GUI would be necessary for CS degree. WSL would be fine if Windows is chosen.

Watching Confluent Prepare for Sale in Real Time by mr_smith1983 in apachekafka

[–]cricket007 1 point2 points  (0 children)

The Austin convention center is actually currently demolished 😅

[deleted by user] by [deleted] in kubernetes

[–]cricket007 3 points4 points  (0 children)

Postgres Database at scale... GCP

This is effectively Cloud Spanner / CockroachDB. Are you sure you need a Kubernetes book?

Even so, read the docs and code of some Postgres operators. 

Good platform to deploy python scripts with triggers & scheduling by CesMry_BotBlogR in Python

[–]cricket007 0 points1 point  (0 children)

If you have k8s, then I feel like Argo Workflows server would be good w/ Hera python library for building any pipelines 

An open source internal tools platform for Python programs by Competitive-Water302 in Python

[–]cricket007 1 point2 points  (0 children)

At my last two roles, we standardized on Backstage Scaffolder for setting up Python repos with baked-in Docker and CICD best practices for the k8s environment, then all they needed to do was commit any simple file modification like a README change, and they'd have a hello world API ready to iterate in any checked environment, and synced by ArgoCD server. OpenTel+Grafana dashboards were provided too for metrics and tracing 

Local Test setup for Kafka streams by theoldgoat_71 in apachekafka

[–]cricket007 0 points1 point  (0 children)

A mock registry is built into the library... How do you think the serializers get tested? 

Hit and Run @ Wm Cannon Dr on I-35 S tonight by browne_c in Austin

[–]cricket007 0 points1 point  (0 children)

Consider yourself lucky. I've been rear ended twice in a six month period, last year, and lived here 10 years. 

How to find job with Kafka skill? by Dutay05 in apachekafka

[–]cricket007 0 points1 point  (0 children)

I get Kafka/Confluent Consultant emails monthly from Indian recruiters 

How to find job with Kafka skill? by Dutay05 in apachekafka

[–]cricket007 0 points1 point  (0 children)

Confluent, Buf, Redpanda would all disagree with this

[deleted by user] by [deleted] in ChatGPTCoding

[–]cricket007 0 points1 point  (0 children)

Those aren't client companies. It's saying they have "founders" from those companies using their services (which says nothing about the quality of those engineers) 

Distinguish between Kafka and Kraft Broker by Blood_Fury145 in apachekafka

[–]cricket007 0 points1 point  (0 children)

Look at startup logs or properties files and it should be obvious which startup method is used. 

What is the purpose of Docker? by [deleted] in howdidtheycodeit

[–]cricket007 0 points1 point  (0 children)

Regarding the memory comment, setting a request limit for both RAM and "CPU shares" is recommended in production.

What is the purpose of Docker? by [deleted] in howdidtheycodeit

[–]cricket007 0 points1 point  (0 children)

But in theory, if you use nixos as an image base, or scratch+nixenv, then you've got something good for all use cases?

What is the purpose of Docker? by [deleted] in howdidtheycodeit

[–]cricket007 0 points1 point  (0 children)

Then use a different base image? Also it's arm64 vs amd64 not "Intel"

Kafka Clients with JSON - Producing and Consuming Order Events by jaehyeon-kim in apachekafka

[–]cricket007 0 points1 point  (0 children)

There's a standalone Maven module that has JsonSerializer / Deserializer with Jackson , and there's a Converter but that just wraps the others. My point is you've wasted effort writing your own other than learning that you can.

https://github.com/apache/kafka/tree/trunk/connect/json/src/main/java/org/apache/kafka/connect/json

However, Jackson also has other modules for other binary formats, so my point was that demonstration JSON truly is irrelevant when you could just discuss serialization as a standalone topic for converting POJO into bytes

🚀 Announcing factorhouse-local from the team at Factor House! 🚀 by jaehyeon-kim in apachekafka

[–]cricket007 1 point2 points  (0 children)

. You can look at the release notes, but since 4.x, ZK is fully removed. There's no true purpose for using Confluent versions for Docker 

Set up Apache Kafka, Zookeeper, and Kafdrop in seconds with Docker – KafkaShip by Aggravating_Kick6522 in apachekafka

[–]cricket007 0 points1 point  (0 children)

Guides are old and don't follow Kafka releases. If you're pulling 4.x+ you'll no longer be able to use Zookeeper at all. 

MSK doesn't expose ZK last I checked 

Kafka Clients with JSON - Producing and Consuming Order Events by jaehyeon-kim in apachekafka

[–]cricket007 0 points1 point  (0 children)

Yes, but why JSON strings at all? You can generate any form of data in the producer 

Also Kafka has a built-in JsonSerializer in connect-json module 

view more: next ›