Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-1588

ListHDFS to retaining wrong state in zookeeper

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.4.1
    • 0.6.0
    • Core Framework
    • None
    • latest 0.5.1

    Description

      The expected state that should be retained by listHDFS processor is the last modified timestamp. The processor instead is retaining the filename and path of every file it lists. This results in excessive disk usage by zookeeper to retain this filename based state.

      Attachments

        Activity

          People

            markap14 Mark Payne
            msclarke Matthew Clarke
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: