Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-908 Support for DAG modifications at runtime
  3. TEZ-1059

Generalize change in connected vertices when the parallelism of a vertex changes

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None

    Description

      When a vertex changes its parallelism, consumer vertices may need to respond to it. 1-1 consumer vertices would need to change their parallelism to match. Scatter-gather consumers dont need to change.
      Currently, the tez dag code has special cased this for 1-1 edge which is fine for now but does not work with custom edges.

      Attachments

        Issue Links

          Activity

            People

              bikassaha Bikas Saha
              bikassaha Bikas Saha
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: