Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-2632

Add fragment attributes for SplitJson and SplitXml

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Resolved
    • Affects Version/s: None
    • Fix Version/s: 1.0.0
    • Component/s: Extensions
    • Labels:
      None

      Description

      Some "splitting" processors such as SplitText and SplitContent write attributes to the split flow files indicating their fragment index, the total count, and the filename of the original flow file. This is done to support a form of "micro-batching" and/or a split-join pattern in a data flow (i.e. split the original file, do work on the individual pieces, and possibly merge them together later).

      For consistency and capability, the SplitJson and SplitXml processors should write these same attributes for their split flow files.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              mattyb149 Matt Burgess
              Reporter:
              mattyb149 Matt Burgess

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment