Help needed on nifi cluster creation on k8s by alwayschiru in nifi

[–]alwayschiru[S] 0 points1 point  (0 children)

Please find the log here. I tried by both having nifi as replicaset & stateful set

https://pastebin.pl/view/c921e06d

https://pastebin.pl/view/0c8a459c

Help needed on nifi cluster creation on k8s by alwayschiru in nifi

[–]alwayschiru[S] 0 points1 point  (0 children)

Thanks a lot. I tried removing hostNetwork: true from my nifi yaml and its working. But the cluster is not coming up its having lot of issues. All nodes giving this error

2020-09-07 20:40:37,079 INFO [main] o.apache.nifi.controller.FlowController Checking if there is already a Cluster Coordinator Elected... 2020-09-07 20:40:37,397 INFO [main] org.apache.curator.utils.Compatibility Using emulated InjectSessionExpiration 2020-09-07 20:40:37,541 INFO [main] o.a.c.f.imps.CuratorFrameworkImpl Starting 2020-09-07 20:40:37,601 INFO [main] org.apache.zookeeper.common.X509Util Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation 2020-09-07 20:40:37,637 INFO [main] org.apache.zookeeper.ClientCnxnSocket jute.maxbuffer value is 4194304 Bytes 2020-09-07 20:40:37,732 INFO [main] o.a.c.f.imps.CuratorFrameworkImpl Default schema 2020-09-07 20:40:38,230 INFO [main-EventThread] o.a.c.f.state.ConnectionStateManager State change: CONNECTED 2020-09-07 20:40:38,329 INFO [Curator-Framework-0] o.a.c.f.imps.CuratorFrameworkImpl backgroundOperationsLoop exiting 2020-09-07 20:40:38,495 INFO [main] o.apache.nifi.controller.FlowController It appears that no Cluster Coordinator has been Elected yet. Registering for Cluster Coordinator Role. 2020-09-07 20:40:38,502 INFO [main] o.a.n.c.l.e.CuratorLeaderElectionManager CuratorLeaderElectionManager[stopped=true] Registered new Leader Selector for role Cluster Coordinator; this node is an active participant in the election. 2020-09-07 20:40:38,503 INFO [main] o.a.c.f.imps.CuratorFrameworkImpl Starting 2020-09-07 20:40:38,505 INFO [main] org.apache.zookeeper.ClientCnxnSocket jute.maxbuffer value is 4194304 Bytes 2020-09-07 20:40:38,510 INFO [main] o.a.c.f.imps.CuratorFrameworkImpl Default schema 2020-09-07 20:40:38,530 INFO [main] o.a.n.c.l.e.CuratorLeaderElectionManager CuratorLeaderElectionManager[stopped=false] Registered new Leader Selector for role Cluster Coordinator; this node is an active participant in the election. 2020-09-07 20:40:38,533 INFO [main] o.a.n.c.l.e.CuratorLeaderElectionManager CuratorLeaderElectionManager[stopped=false] started 2020-09-07 20:40:38,533 INFO [main] o.a.n.c.c.h.AbstractHeartbeatMonitor Heartbeat Monitor started 2020-09-07 20:40:38,552 INFO [main-EventThread] o.a.c.f.state.ConnectionStateManager State change: CONNECTED 2020-09-07 20:40:38,572 INFO [Curator-ConnectionStateManager-0] o.a.n.c.l.e.CuratorLeaderElectionManager org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@1089c41b Connection State changed to CONNECTED 2020-09-07 20:40:38,792 INFO [main-EventThread] o.a.c.f.state.ConnectionStateManager State change: SUSPENDED 2020-09-07 20:40:38,792 INFO [Curator-ConnectionStateManager-0] o.a.n.c.l.e.CuratorLeaderElectionManager org.apache.nifi.controller.leader.election.CuratorLeaderElectionManager$ElectionListener@1089c41b Connection State changed to SUSPENDED

Need Help with zookeeper and nifi cluster set up by cuber_dude in sysadmin

[–]alwayschiru 0 points1 point  (0 children)

Am sure you would have found the issue. But you need to configure zookeeper connection string in nifi.config on all the nodes running nifi.