Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1233

Allow configuration of framework parameters per vertex

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.7.0
    • None
    • None

    Description

      Currently, configuration properties specific in AMConfiguration are used to configure tasks - e.g. memory configs, process tree, etc. These should be configurable at a Vertex level.

      Also, tasks end up reading these configs from the dist cache each time - would be simpler to send over the wire as part of the TaskSpec.

      Attachments

        1. TEZ-1233-1.patch
          64 kB
          Jeff Zhang
        2. TEZ-1233-2.patch
          72 kB
          Jeff Zhang
        3. TEZ-1233-3.patch
          73 kB
          Jeff Zhang
        4. TEZ-1233-4.patch
          73 kB
          Jeff Zhang

        Issue Links

          is depended upon by

          Sub-task - The sub-task of the issue TEZ-1788 Test allowing vertex level disabling of speculation

          • Major - Major loss of function.
          • Closed
          is required by

          Improvement - An improvement or enhancement to an existing feature or task. TEZ-2003 [Umbrella] Allow Tez to co-ordinate execution to external services

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              zjffdu Jeff Zhang
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: