Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5347

Nifi - GETHDFS processor not able to find the files in HDFS / Processor is getting stuck

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.6.0
    • Fix Version/s: None
    • Component/s: Configuration
    • Labels:
      None
    • Flags:
      Important

      Description

      Hi 

      Nifi GETHDFS processor gets stuck/hung or not able to idnentify the files in HDFS directory.

      While i let the process to keep retrying multiple times with a schedule state of retry in every 0 second, the processor identifies the file after 300-400 retries.

      Sharing the log information below:

      2018-06-28 11:47:15,853 INFO [NiFi Web Server-100] o.a.n.c.s.StandardProcessScheduler Starting GetHDFS[id=809d3a14-f0ec-1e4f-ca1e-9fbce341b4f5]
      2018-06-28 11:47:15,896 INFO [Monitor Processore Lifecycle Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled GetHDFS[id=809d3a14-f0ec-1e4f-ca1e-9fbce341b4f5] to run with 1 threads
      2018-06-28 11:47:16,214 INFO [Flow Service Tasks Thread-2] o.a.nifi.controller.StandardFlowService Saved flow controller org.apache.nifi.controller.FlowController@33dbd739 // Another save pending = false

       

      Earlier this was working smooth, the issue is noticed after we restarted the  nifi restart? Could somebody help with the unexpected behaviour or issue noticed.

       

        Attachments

        1. text
          55 kB
          Ahmed
        2. nifi-app.log
          15.38 MB
          Ahmed

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Big-D Ahmed
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: