Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-71 Support new partitioning strategies
  3. SAMZA-123

Move topic partition grouping to the AM and generalize

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.6.0
    • 0.8.0
    • container

    Description

      Currently the AM sends a set of all the topics and partitions to the container, which then groups them by partition and assigns each set to a task instance. By moving the grouping to the AM, we can assign arbitrary groups to task instances, which will allow more partitioning strategies, as discussed in SAMZA-71.

      Attachments

        1. SAMZA-123-2.patch
          193 kB
          Jakob Homan
        2. SAMZA-123-3.patch
          193 kB
          Jakob Homan
        3. SAMZA-123-4.patch
          202 kB
          Jakob Homan
        4. SAMZA-123-5.patch
          204 kB
          Jakob Homan
        5. SAMZA-123-6.patch
          214 kB
          Jakob Homan
        6. SAMZA-123-7.patch
          212 kB
          Jakob Homan
        7. SAMZA-123-8.patch
          252 kB
          Jakob Homan
        8. SAMZA-123-design-doc.md
          21 kB
          Jakob Homan
        9. SAMZA-123-design-doc.pdf
          161 kB
          Jakob Homan
        10. SAMZA-123-draft.patch
          171 kB
          Jakob Homan

        Issue Links

          Activity

            People

              jghoman Jakob Homan
              jghoman Jakob Homan
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: