Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-6339

ListHDFS processor will list files without using previous state when cluster startup

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.9.0, 1.9.1, 1.9.2
    • Fix Version/s: 1.10.0
    • Component/s: Core Framework
    • Labels:
      None

      Description

      When the node startup, NiFi will create processor and load the property & state.

      But ListHDFS will ignore the previous listed-state stored on Zookeeper, and relist all file again.

       

      And I found when we call the function setProperty, we only check the value between default and newValue. If oldValue is same with newValue, it'll also trigger function onPropertyModified.

      It casue ListHDFS loaclVariable: resetState to be true. When ListHDFS be triggered, it'll clear the state empty, and relist all the files in the directory.

       

      // AbstractComponentNode.java
      
      if (!value.equals(propertyModComparisonValue)) {
          try {
              onPropertyModified(descriptor, oldValue, value);
          } catch (final Exception e) {
              // nothing really to do here...
          }
      }
      

       

       

        Attachments

        1. NIFI-6339.v0.patch
          2 kB
          Hsin-Ying Lee

          Issue Links

            Activity

              People

              • Assignee:
                markap14 Mark Payne
                Reporter:
                s9514171 Hsin-Ying Lee
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m