Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-3828

Allow relaxing locality when retried task's priority is kept same

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.1
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      TEZ-3716 introduced the conf to keep priority for retried task, but there is no way to relax locality requirement in that case.

      1. TEZ-3828.1.patch
        6 kB
        Zhiyuan Yang
      2. TEZ-3828.2.patch
        6 kB
        Zhiyuan Yang
      3. TEZ-3828.3.patch
        6 kB
        Zhiyuan Yang

        Issue Links

          Activity

          Hide
          aplusplus Zhiyuan Yang added a comment -

          Re-submit patch, triggering jenkins build

          Show
          aplusplus Zhiyuan Yang added a comment - Re-submit patch, triggering jenkins build
          Hide
          tezqa TezQA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12885866/TEZ-3828.2.patch
          against master revision 9fd0578.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 findbugs. The patch does not introduce any new Findbugs (version 3.0.1) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          Test results: https://builds.apache.org/job/PreCommit-TEZ-Build/2626//testReport/
          Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/2626//console

          This message is automatically generated.

          Show
          tezqa TezQA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12885866/TEZ-3828.2.patch against master revision 9fd0578. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 findbugs . The patch does not introduce any new Findbugs (version 3.0.1) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-TEZ-Build/2626//testReport/ Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/2626//console This message is automatically generated.
          Hide
          tezqa TezQA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12885923/TEZ-3828.3.patch
          against master revision 9fd0578.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 findbugs. The patch does not introduce any new Findbugs (version 3.0.1) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          Test results: https://builds.apache.org/job/PreCommit-TEZ-Build/2627//testReport/
          Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/2627//console

          This message is automatically generated.

          Show
          tezqa TezQA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12885923/TEZ-3828.3.patch against master revision 9fd0578. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 findbugs . The patch does not introduce any new Findbugs (version 3.0.1) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-TEZ-Build/2627//testReport/ Console output: https://builds.apache.org/job/PreCommit-TEZ-Build/2627//console This message is automatically generated.
          Hide
          aplusplus Zhiyuan Yang added a comment -

          Siddharth Seth Can you help review this?

          Show
          aplusplus Zhiyuan Yang added a comment - Siddharth Seth Can you help review this?
          Hide
          aplusplus Zhiyuan Yang added a comment -

          Harish Jaiprakash Are you able to help review this? It's mostly similar to TEZ-3716.

          Show
          aplusplus Zhiyuan Yang added a comment - Harish Jaiprakash Are you able to help review this? It's mostly similar to TEZ-3716 .
          Hide
          harishjp Harish Jaiprakash added a comment -

          Thanks Zhiyuan Yang. +1 for the change.

          Show
          harishjp Harish Jaiprakash added a comment - Thanks Zhiyuan Yang . +1 for the change.
          Hide
          aplusplus Zhiyuan Yang added a comment -

          Thank you Harish Jaiprakash! Committing...

          Show
          aplusplus Zhiyuan Yang added a comment - Thank you Harish Jaiprakash ! Committing...

            People

            • Assignee:
              aplusplus Zhiyuan Yang
              Reporter:
              aplusplus Zhiyuan Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development