Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5443

Improve cluster configuration for dynamic scaling

    XMLWordPrintableJSON

Details

    Description

      Currently, NiFi is designed for static clusters, with frequent references in configuration files to a priori knowledge of node hostnames, ports, etc.

      Efforts should be taken to make NiFi easier to dynamically scale. This can involve containerization improvements via Docker/rkt, deployment improvements via Kubernetes, and abstraction of the configuration values needed to stand up the cluster. A node should be able to join the cluster, and, given the correct keystore and truststore, immediately communicate with other existing nodes in the cluster without requiring direct configuration changes to them, or a restart of any node.

      • authorizers.xml
      • node identities
      • permissions (RW on /proxy)
      • ZooKeeper configuration
      • etc.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              alopresto Andy LoPresto
              Votes:
              13 Vote for this issue
              Watchers:
              19 Start watching this issue

              Dates

                Created:
                Updated: