Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-7856

Provenance failed to be compressed after nifi upgrade to 1.12

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.12.0
    • 1.13.0
    • None
    • None

    Description

      We upgraded our nifi cluster from 1.11.3 to 1.12.0.

      The nodes come up and everything looks to be functional. I can see 1.12.0 is running.

      Later on, we discovered that the data provenance is missing. From checking our logs, we see tons of errors compressing the logs.

      2020-09-28 03:38:35,205 ERROR [Compress Provenance Logs-1-thread-1] o.a.n.p.s.EventFileCompressor Failed to compress ./provenance_repository/2752821.prov on rollover
      

      This didn't happen in 1.11.3.

      Is this a known issue? We are considering reverting back if there is no solution for this since we can't go prod with no/broken data provenance.

      Attachments

        1. NIFI-7856.xml
          1.24 MB
          Mark Payne
        2. screenshot-3.png
          446 kB
          Mengze Li
        3. 1683472.prov
          37 kB
          Mengze Li
        4. screenshot-2.png
          872 kB
          Mengze Li
        5. ls.png
          384 kB
          Mengze Li
        6. screenshot-1.png
          276 kB
          Mengze Li

        Issue Links

          Activity

            People

              markap14 Mark Payne
              leeyoda Mengze Li
              Votes:
              3 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m