Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-739

Update Kite storage processor to cache writers

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Abandoned
    • 0.1.0
    • None
    • Extensions
    • None

    Description

      The StoreInKiteProcessor currently opens and closes a new dataset writer for each file, creating lots of small files. Instead, the processor should keep writers open and periodically refresh them if data should be made available. This will make it much easier to delegate file management to Kite in the future.

      Attachments

        Issue Links

          is superceded by

          Improvement - An improvement or enhancement to an existing feature or task. NIFI-9591 Remove Kite Processors

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link WIP branch

          Activity

            People

              rdblue Ryan Blue
              rdblue Ryan Blue
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: