Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: 0.9.1
    • Component/s: None
    • Labels:
      None

      Description

      To reproduce:

      Create a job that reads from two topics with equal number of partitions > 1. Configure the job to bootstrap from one of the topics and set yarn.container.count > 1.

      Observed outcome:

      You'll see that the container completes bootstrapping for the partitions assigned to it's tasks but never finishes bootstrapping for the remaining partitions that are assigned to other containers.

      Expected outcome:

      When each task as finished bootstrapping the partitions it's responsible for, bootstrapping should be considered complete.

      Debug logs available here: https://mail-archives.apache.org/mod_mbox/samza-dev/201506.mbox/%3CCAPOm%3DTN88YSbn_pzpb-%2BwGxc619LsE%3D-XAfaydBKmLrTLOf4QA%40mail.gmail.com%3E

        Attachments

        1. SAMZA-720.patch
          2 kB
          Yan Fang
        2. SAMZA-720.1.patch
          3 kB
          Yan Fang

          Activity

            People

            • Assignee:
              closeuris Yan Fang
              Reporter:
              theduderog Roger Hoover
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: