Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5443

Improve cluster configuration for dynamic scaling

    XMLWordPrintableJSON

    Details

      Description

      Currently, NiFi is designed for static clusters, with frequent references in configuration files to a priori knowledge of node hostnames, ports, etc.

      Efforts should be taken to make NiFi easier to dynamically scale. This can involve containerization improvements via Docker/rkt, deployment improvements via Kubernetes, and abstraction of the configuration values needed to stand up the cluster. A node should be able to join the cluster, and, given the correct keystore and truststore, immediately communicate with other existing nodes in the cluster without requiring direct configuration changes to them, or a restart of any node.

      • authorizers.xml
      • node identities
      • permissions (RW on /proxy)
      • ZooKeeper configuration
      • etc.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                alopresto Andy LoPresto
              • Votes:
                9 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated: