Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-71 Support new partitioning strategies
  3. SAMZA-123

Move topic partition grouping to the AM and generalize

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.6.0
    • 0.8.0
    • container

    Description

      Currently the AM sends a set of all the topics and partitions to the container, which then groups them by partition and assigns each set to a task instance. By moving the grouping to the AM, we can assign arbitrary groups to task instances, which will allow more partitioning strategies, as discussed in SAMZA-71.

      Attachments

        1. SAMZA-123-draft.patch
          171 kB
          Jakob Homan
        2. SAMZA-123-design-doc.pdf
          161 kB
          Jakob Homan
        3. SAMZA-123-design-doc.md
          21 kB
          Jakob Homan
        4. SAMZA-123-8.patch
          252 kB
          Jakob Homan
        5. SAMZA-123-7.patch
          212 kB
          Jakob Homan
        6. SAMZA-123-6.patch
          214 kB
          Jakob Homan
        7. SAMZA-123-5.patch
          204 kB
          Jakob Homan
        8. SAMZA-123-4.patch
          202 kB
          Jakob Homan
        9. SAMZA-123-3.patch
          193 kB
          Jakob Homan
        10. SAMZA-123-2.patch
          193 kB
          Jakob Homan

        Issue Links

          is depended upon by

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-353 Support assigning the same SSP to multiple tasknames

          • Major - Major loss of function.
          • Reopened

          Task - A task that needs to be done. SAMZA-355 Provide a SystemStreamPartitionGrouper that groups into N sets

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. SAMZA-354 Write tool to convert old-style checkpoint log to post-SAMZA-123 format

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-370 Document changes from SAMZA-123

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-371 Rename job.systemstreampartition.grouper.factory

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-374 Need to be able to change SSP Grouper

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link Review Board

          Activity

            People

              jghoman Jakob Homan
              jghoman Jakob Homan
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: