Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-1327

Evaluate/Port JStorm tuple batching

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: storm-core
    • Labels:

      Description

      Storm:
      Batching in DisruptorQueue

      JStorm:
      Do batch before sending tuple to transfer queue and support for adjusting the batch size dynamically according to samples of actual batch size sent out for past intervals.

      Should evaluate both implementations, and see which is better for performance, and possible if we can/should move some of the dynamic batching logic into disruptor.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                basti.lj Basti Liu
                Reporter:
                revans2 Robert Joseph Evans
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: