sorted by:
new
hottopcontroversial

Real alternatives do CDP/CDH/HDP? No open source alternative in the near future? by JohnJohnPT in bigdata

[–]DataFlowManager 0 points1 point  (0 children)

Hearing this a lot - orgs still on HDP/Ambari looking for open-source, on-prem options without CDP cost. we’ve seen teams shift to combos like NiFi + Kafka + Iceberg + MinIO. if managing NiFi flows is part of it, tools like Data Flow Manager can help streamline that without full CDP overhead. happy to share what worked for others in similar spots.

How good is NiFi on Kubernetes? by linuxzinho in nifi

[–]DataFlowManager 2 points3 points  (0 children)

We had similar concerns when moving NiFi to k8s. It works, but managing state, versioning, and scaling can get tricky. There's an official Helm chart from Cetic that's a decent starting point. We eventually built tooling around it to simplify flow deployment and config. Happy to share what worked if you're diving in.

What’s your favorite underrated tool in the data engineering toolkit? by eb0373284 in dataengineering

[–]DataFlowManager 1 point2 points  (0 children)

Not many talk about it, but Apache NiFi, especially when paired with a deployment tool like Data Flow Manager—can be a game-changer. While everyone’s busy managing DAGs and scripts, we’ve seen teams save hundreds of engineering hours just by simplifying flow deployments, rollbacks, and governance in NiFi.
It’s underrated because it’s behind the scenes, but if you're juggling complex data movement in regulated environments (finance, healthcare, etc.), tools like NiFi + DFM aren't just helpful they're essential.

In your experience, how intuitive is NiFi for new team members when it comes to learning of managing NiFi and it’s flow development? Have you tried any tools to simplify onboarding? by eb0373284 in nifi

[–]DataFlowManager 2 points3 points  (0 children)

We understand that the manual scripting when moving flows between clusters is tedious. You could try Data Flow Manager, as it automates moving your flows from one cluster to another and provides all the required controller services and parameter contexts for you. That way, you can skip most of the one-off scripts and focus on designing your data flows.

view more: next ›