Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5347

Nifi - GETHDFS processor not able to find the files in HDFS / Processor is getting stuck

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.6.0
    • Fix Version/s: None
    • Component/s: Configuration
    • Labels:
      None
    • Flags:
      Important

      Description

      Hi 

      Nifi GETHDFS processor gets stuck/hung or not able to idnentify the files in HDFS directory.

      While i let the process to keep retrying multiple times with a schedule state of retry in every 0 second, the processor identifies the file after 300-400 retries.

      Sharing the log information below:

      2018-06-28 11:47:15,853 INFO [NiFi Web Server-100] o.a.n.c.s.StandardProcessScheduler Starting GetHDFS[id=809d3a14-f0ec-1e4f-ca1e-9fbce341b4f5]
      2018-06-28 11:47:15,896 INFO [Monitor Processore Lifecycle Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled GetHDFS[id=809d3a14-f0ec-1e4f-ca1e-9fbce341b4f5] to run with 1 threads
      2018-06-28 11:47:16,214 INFO [Flow Service Tasks Thread-2] o.a.nifi.controller.StandardFlowService Saved flow controller org.apache.nifi.controller.FlowController@33dbd739 // Another save pending = false

       

      Earlier this was working smooth, the issue is noticed after we restarted the  nifi restart? Could somebody help with the unexpected behaviour or issue noticed.

       

        Attachments

        1. nifi-app.log
          15.38 MB
          Ahmed
        2. text
          55 kB
          Ahmed

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Big-D Ahmed
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: