Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-2471

Multiple Hadoop processors cannot point to different Hadoop clusters

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.7.0
    • 1.0.0, 0.7.1, 1.0.0-Beta
    • Extensions
    • None

    Description

      Two GetHDFS processors, each with different Hadoop Configuration Resources, will only operate with one Hadoop cluster. In this specific case, both Hadoop clusters had the same HDFS system name. The AbstractHadoopProcessor disables caching of Configuration and FileSystem objects but it doesn't appear to be working.

      Also, if I configure a GetHDFS processor to point to one Hadoop cluster, but the processor is invalid because the Directory doesn't exist, the processor doesn't start (that's good). But if I change the Hadoop Configuration Resources to point to a different Hadoop cluster where the Directory does exist, then GetHDFS continues to talk to the first Hadoop cluster. It seems like the Configuration and FileSystem objects don't reset when I change the Hadoop Configuration Resources property.

      Attachments

        Issue Links

          Activity

            People

              mosermw Michael W Moser
              mosermw Michael W Moser
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: