Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-2687 Elasticity: scale up task count beyond the input partition count.
  3. SAMZA-2732

[Elasticity] Add elasticityFactor into the TaskName when elasticity is enabled

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      When elasticity is enabled, update the task name for
      1. GroupByPartition SSP grouper from "Partition 0 1" to "Partition 0_1_2" where 0 is the input partition, 1 is the keyBucket and 2 is the elasticity factor.
      2. GroupBySystemStreamPartition SSP grouper from "SystemStreamPartition [systemA, streamB, 0, 1]" to "SystemStreamPartition [systemA, streamB, 0, 1]_2" where 0 is the input partition, 1 is the keyBucket and 2 is the elasticity factor.

      elasticity is not supported for other SSP groupers.

      Attachments

        Activity

          People

            lakshmi-manasa Lakshmi Manasa Gaduputi
            lakshmi-manasa Lakshmi Manasa Gaduputi
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 0.5h
                0.5h