Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-2632

Add fragment attributes for SplitJson and SplitXml

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Resolved
    • None
    • 1.0.0
    • Extensions
    • None

    Description

      Some "splitting" processors such as SplitText and SplitContent write attributes to the split flow files indicating their fragment index, the total count, and the filename of the original flow file. This is done to support a form of "micro-batching" and/or a split-join pattern in a data flow (i.e. split the original file, do work on the individual pieces, and possibly merge them together later).

      For consistency and capability, the SplitJson and SplitXml processors should write these same attributes for their split flow files.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mattyb149 Matt Burgess
            mattyb149 Matt Burgess
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment