Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5109

AbstractListProcessor stop calling performListing after primary node reelection

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.7.0
    • Component/s: Core Framework
    • Labels:
      None

      Description

      AbstractListProcessor stops performing listing of entities when after reelection the same node becomes Primary.

      STEPS TO REPRODUCE:

      0. Make sure that you have docker 18.03.0-ce
      1. Download attached docker-compose.yml and PutAndListSFTP.xml
      2. Run docker-compose up -d in the folder where you downloaded
      docker-compose.yml. This command will run 3 containers - Zookeeper, NiFi
      1.6.0 in Cluster Mode with 1 node, SFTPs server
      3. After NiFi is up and running (check http://localhost:8080/nifi) upload
      PutAndListSFTP.xml template and place it on NiFi canvas. It has simple logic

      • generate flow file each 10 seconds and put it on SFTP, in parallel
        ListSFTP processor "listens" for the new files and pushes data about them to
        NiFi log with LogAttribute processor
        4. Update PutSFTP and ListSFTP processors with password admin (to check SFTP
        container use following credentials SFTP://admin:admin@localhost:2222)
        5. Run the flow
        6. Check the NiFi log (docker logs -f --tail 100 nifi) - you should see
        attributes for the uploaded files on SFTP
        7. Check that generated each 10 seconds files appear on SFTP /upload folder
        8. Run following command to restart Zookeeper to put NiFi in reelection
        state: docker restart zookeeper
        9. After reelection phase finished check that new files appears on SFTP, but
        NO new files info appears in NiFi log

       

        Attachments

        1. 0001-NIFI-2109-Reset-justElectedPrimaryNode-flag-right-af.patch
          2 kB
          Maksym Viazovskyi
        2. PutAndListSFTP.xml
          29 kB
          Maksym Viazovskyi
        3. docker-compose.yml
          0.5 kB
          Maksym Viazovskyi

          Issue Links

            Activity

              People

              • Assignee:
                dalong Maksym Viazovskyi
                Reporter:
                dalong Maksym Viazovskyi
              • Votes:
                1 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 72h
                  72h
                  Remaining:
                  Remaining Estimate - 72h
                  72h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified