Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-1588

ListHDFS to retaining wrong state in zookeeper

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.4.1
    • Fix Version/s: 0.6.0
    • Component/s: Core Framework
    • Labels:
      None
    • Environment:
      latest 0.5.1

      Description

      The expected state that should be retained by listHDFS processor is the last modified timestamp. The processor instead is retaining the filename and path of every file it lists. This results in excessive disk usage by zookeeper to retain this filename based state.

        Attachments

          Activity

            People

            • Assignee:
              markap14 Mark Payne
              Reporter:
              msclarke Matthew Clarke
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: