Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5347

Nifi - GETHDFS processor not able to find the files in HDFS / Processor is getting stuck

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Information Provided
    • 1.6.0
    • None
    • Configuration
    • None
    • Important

    Description

      Hi 

      Nifi GETHDFS processor gets stuck/hung or not able to idnentify the files in HDFS directory.

      While i let the process to keep retrying multiple times with a schedule state of retry in every 0 second, the processor identifies the file after 300-400 retries.

      Sharing the log information below:

      2018-06-28 11:47:15,853 INFO [NiFi Web Server-100] o.a.n.c.s.StandardProcessScheduler Starting GetHDFS[id=809d3a14-f0ec-1e4f-ca1e-9fbce341b4f5]
      2018-06-28 11:47:15,896 INFO [Monitor Processore Lifecycle Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled GetHDFS[id=809d3a14-f0ec-1e4f-ca1e-9fbce341b4f5] to run with 1 threads
      2018-06-28 11:47:16,214 INFO [Flow Service Tasks Thread-2] o.a.nifi.controller.StandardFlowService Saved flow controller org.apache.nifi.controller.FlowController@33dbd739 // Another save pending = false

       

      Earlier this was working smooth, the issue is noticed after we restarted the  nifi restart? Could somebody help with the unexpected behaviour or issue noticed.

       

      Attachments

        1. nifi-app.log
          15.38 MB
          Ahmed
        2. text
          55 kB
          Ahmed

        Activity

          People

            Unassigned Unassigned
            Big-D Ahmed
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: