Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-6023

ListHDFS throws misleading exception regarding Distributed Cache Service

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.8.0
    • 1.9.0
    • Extensions
    • None

    Description

      In the `ListHDFS.onTrigger` method, the processor attempts to retrieve the state for the processor which can throw an IOException. The catch block for that code logs the exception with a message of `Failed to retrieve timestamp of last listing from Distributed Cache Service. Will not perform listing until this is accomplished`. This is misleading, since the DistributedMapCacheClient is not used by ListHDFS.

      The error message should be updated to inform the user of the actual error, that the state manager could not be reached, or state could not be retrieved from the state manager. It'd also help to include the exception (stack trace) itself in the log.

      The `Distributed Cache Service` property should be deprecated and its description should be updated, since the property will be ignored. State is stored by the state manager locally, or in ZK if NiFi is clustered.

      Attachments

        Issue Links

          Activity

            People

              jtstorck Jeff Storck
              jtstorck Jeff Storck
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h