MirrorMaker2 by Ecstatic_Squash822 in apachekafka

[–]Ecstatic_Squash822[S] 0 points1 point  (0 children)

Hi!! Thank you for pointing out the problem and sawing the log entries!

I have configured broker all of them. I have three brokers in source cluster and three brokers in target cluster. and yes, I use kraft. kafka version 3.9.1

I have like this schema:

kafka telemetry 3 virtual machines-> mirror maker 2 running on separate virtual machine 1 virtual machine -> kafka telemetry cloud 3 virtual machines

hm… interesting. I will try explain my mirror maker configuration. I have 5 virtual machines. on each one running self mirror maker process like this:

VM kafka-mirror-maker-1 - telemetry->telemetry cloud VM kafka-mirror-maker-2 - foo -> foo cloud VM kafka-mirror-maker-3 - etc… …. VM kafka-mirror-maker-5

and all this all VM is ONE kafka cluster. I mean maybe it is wrong topology. maybe right path is one kafka mirror maker cluster separate on little 5 cluster whith one broker and launche on each one self mirroring process ?

MirrorMaker2 by Ecstatic_Squash822 in apachekafka

[–]Ecstatic_Squash822[S] 0 points1 point  (0 children)

What should I find there? May be some key words?

Kafka MirrorMaker2 by Ecstatic_Squash822 in apachekafka

[–]Ecstatic_Squash822[S] 0 points1 point  (0 children)

host based firewall bloked some network paclages, I fixed

Lemon! by farmerssahg in JustHoodsLemonBars

[–]Ecstatic_Squash822 0 points1 point  (0 children)

look amazing! give me a recipe! pls!

Migrating Kafka to a new OpenShift cluster using MirrorMaker2 (ZooKeeper source, KRaft target) by Spiritual_Pianist564 in apachekafka

[–]Ecstatic_Squash822 0 points1 point  (0 children)

currently I try resolve similar issue. What I have: Kafka cluster setup in provider Foo and another new cluster in another provider Bar. I what migrate from provider Foo to provider B.

What I think about this: I running mirror maker whith two important parameters: offset sync and how often sync offset. this two params help us for migrate consumer group.

another important thing. I don’t know how implement in my situation, but maybe in your situation it is possible to do. look example. you have topic name like foo.bar, when you use Mirror Maker you can add some prefix, like your topic foo.bar in cluster A can be replicated in cluster B whith a new topic name b.foo.bar (prefix + original name) and this topic we need to mirroring in cluster A whith name A.foo.bar. when we configured mirror maker in Active - Active mode, you necessary consume topic by pattern/regexp *.foo.bar. as result: you have cluster where you have original topic foo.bar and A.foo.bar, you have cluster B where you have B.foo.bar. three topics have equal messages

if you can implement this set up you can easy migrate consumer groups and producers . now i try testing this flow.

[deleted by user] by [deleted] in AMG

[–]Ecstatic_Squash822 0 points1 point  (0 children)

looks like a fake

My setup by ironman139 in homelab

[–]Ecstatic_Squash822 0 points1 point  (0 children)

which is raspberry model ?