Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1170

Simplify Vertex Initializing transition

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.5.0
    • None
    • None

    Description

      After TEZ-1145 and 1151, a vertex should only need to stay in INITIALZING state when it has an uninitialized edge, or when the parallelism is at -1 (not set yet). Waiting for all RootInputInitializers to complete should not be required - as long as one of them sets parallelism (via a VertexManager).

      Attachments

        1. TEZ-1170.1.patch
          35 kB
          Bikas Saha
        2. TEZ-1170.2.patch
          48 kB
          Bikas Saha
        3. TEZ-1170.3.addendum.patch
          4 kB
          Bikas Saha

        Issue Links

          is related to

          Sub-task - The sub-task of the issue PIG-3846 Implement automatic reducer parallelism

          • Major - Major loss of function.
          • Closed

          Activity

            People

              bikassaha Bikas Saha
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: