Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-6023

ListHDFS throws misleading exception regarding Distributed Cache Service

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.8.0
    • Fix Version/s: 1.9.0
    • Component/s: Extensions
    • Labels:
      None

      Description

      In the `ListHDFS.onTrigger` method, the processor attempts to retrieve the state for the processor which can throw an IOException. The catch block for that code logs the exception with a message of `Failed to retrieve timestamp of last listing from Distributed Cache Service. Will not perform listing until this is accomplished`. This is misleading, since the DistributedMapCacheClient is not used by ListHDFS.

      The error message should be updated to inform the user of the actual error, that the state manager could not be reached, or state could not be retrieved from the state manager. It'd also help to include the exception (stack trace) itself in the log.

      The `Distributed Cache Service` property should be deprecated and its description should be updated, since the property will be ignored. State is stored by the state manager locally, or in ZK if NiFi is clustered.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jtstorck Jeff Storck
                Reporter:
                jtstorck Jeff Storck
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h