Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-354

Allow updating of payload during dag construction

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.2.0
    • None
    • None

    Description

      Since I need to call:

      MultiStageMRConfToTezTranslator.translateVertexConfToTez(vertexConf, predecessorConf);

      for each edge to translate the graph into a dag, it would be really helpful if I could separate creation of the vertex from setting the final payload. That way I don't have to traverse the graph multiple times.

      I believe that payload is only used once submit is called, so this shouldn't be much of a problem.

      Attachments

        1. TEZ-354.3.patch
          33 kB
          Gunther Hagleitner
        2. TEZ-354.2.patch
          3 kB
          Gunther Hagleitner
        3. TEZ-354.1.patch
          0.9 kB
          Gunther Hagleitner

        Issue Links

          Activity

            People

              hagleitn Gunther Hagleitner
              hagleitn Gunther Hagleitner
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: