Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-2805

Add fragment attributes for SplitAvro

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0
    • None
    • None

    Description

      Some "splitting" processors such as SplitText and SplitContent write attributes to the split flow files indicating their fragment index, the total count, and the filename of the original flow file. This is done to support a form of "micro-batching" and/or a split-join pattern in a data flow (i.e. split the original file, do work on the individual pieces, and possibly merge them together later).
      For consistency and capability, the SplitAvro processor should write these same attributes for its split flow files.

      Attachments

        Issue Links

          Activity

            People

              mattyb149 Matt Burgess
              mattyb149 Matt Burgess
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: