Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-1327

Evaluate/Port JStorm tuple batching

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: storm-core
    • Labels:

      Description

      Storm:
      Batching in DisruptorQueue

      JStorm:
      Do batch before sending tuple to transfer queue and support for adjusting the batch size dynamically according to samples of actual batch size sent out for past intervals.

      Should evaluate both implementations, and see which is better for performance, and possible if we can/should move some of the dynamic batching logic into disruptor.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              basti.lj Basti Liu
              Reporter:
              revans2 Robert Joseph Evans

              Dates

              • Created:
                Updated:

                Issue deployment