Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7157

Add admin configuration to filter per-user's apps in secure cluster

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-beta1, 3.1.0
    • Component/s: webapp
    • Labels:
      None

      Description

      A user who is accessing a secure cluster via a secure UI should be able to see only his/her own apps.

      This feature will not break any compatibility as it will turned off by default

      1. YARN-7157.001.patch
        6 kB
        Sunil G
      2. YARN-7157.002.patch
        10 kB
        Sunil G
      3. YARN-7157.003.patch
        10 kB
        Sunil G
      4. YARN-7157.004.patch
        8 kB
        Rohith Sharma K S
      5. YARN-7157.005.patch
        9 kB
        Sunil G
      6. YARN-7157-branch-2.001.patch
        9 kB
        Rohith Sharma K S
      7. YARN-7157-branch-2.002.patch
        9 kB
        Sunil G
      8. YARN-7157-branch-3.0.001.patch
        9 kB
        Rohith Sharma K S
      9. YARN-7157-branch-3.0.002.patch
        9 kB
        Sunil G

        Activity

        Hide
        sunilg Sunil G added a comment -
        Show
        sunilg Sunil G added a comment - cc/ Wangda Tan and Junping Du
        Hide
        rohithsharma Rohith Sharma K S added a comment -

        thanks Sunil G for the patch! It reasonable to me. Submitting the patch to run Jenkins.

        Show
        rohithsharma Rohith Sharma K S added a comment - thanks Sunil G for the patch! It reasonable to me. Submitting the patch to run Jenkins.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 19s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
              trunk Compile Tests
        0 mvndep 0m 23s Maven dependency ordering for branch
        +1 mvninstall 13m 22s trunk passed
        +1 compile 8m 59s trunk passed
        +1 checkstyle 1m 0s trunk passed
        +1 mvnsite 1m 50s trunk passed
        +1 findbugs 3m 4s trunk passed
        +1 javadoc 1m 23s trunk passed
              Patch Compile Tests
        0 mvndep 0m 11s Maven dependency ordering for patch
        +1 mvninstall 1m 19s the patch passed
        +1 compile 5m 37s the patch passed
        +1 javac 5m 37s the patch passed
        +1 checkstyle 0m 59s the patch passed
        +1 mvnsite 1m 47s the patch passed
        +1 whitespace 0m 1s The patch has no whitespace issues.
        +1 findbugs 3m 21s the patch passed
        +1 javadoc 1m 21s the patch passed
              Other Tests
        -1 unit 0m 34s hadoop-yarn-api in the patch failed.
        +1 unit 1m 52s hadoop-yarn-server-common in the patch passed.
        -1 unit 46m 16s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 asflicense 0m 29s The patch does not generate ASF License warnings.
        102m 55s



        Reason Tests
        Failed junit tests hadoop.yarn.conf.TestYarnConfigurationFields
          hadoop.yarn.server.resourcemanager.webapp.TestRMWebApp
          hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation
          hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:71bbb86
        JIRA Issue YARN-7157
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12885401/YARN-7157.001.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 65c463d47456 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 6f101e7
        Default Java 1.8.0_144
        findbugs v3.1.0-RC1
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17322/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17322/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17322/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/17322/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 19s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.       trunk Compile Tests 0 mvndep 0m 23s Maven dependency ordering for branch +1 mvninstall 13m 22s trunk passed +1 compile 8m 59s trunk passed +1 checkstyle 1m 0s trunk passed +1 mvnsite 1m 50s trunk passed +1 findbugs 3m 4s trunk passed +1 javadoc 1m 23s trunk passed       Patch Compile Tests 0 mvndep 0m 11s Maven dependency ordering for patch +1 mvninstall 1m 19s the patch passed +1 compile 5m 37s the patch passed +1 javac 5m 37s the patch passed +1 checkstyle 0m 59s the patch passed +1 mvnsite 1m 47s the patch passed +1 whitespace 0m 1s The patch has no whitespace issues. +1 findbugs 3m 21s the patch passed +1 javadoc 1m 21s the patch passed       Other Tests -1 unit 0m 34s hadoop-yarn-api in the patch failed. +1 unit 1m 52s hadoop-yarn-server-common in the patch passed. -1 unit 46m 16s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 29s The patch does not generate ASF License warnings. 102m 55s Reason Tests Failed junit tests hadoop.yarn.conf.TestYarnConfigurationFields   hadoop.yarn.server.resourcemanager.webapp.TestRMWebApp   hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation   hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation Subsystem Report/Notes Docker Image:yetus/hadoop:71bbb86 JIRA Issue YARN-7157 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12885401/YARN-7157.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 65c463d47456 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 6f101e7 Default Java 1.8.0_144 findbugs v3.1.0-RC1 unit https://builds.apache.org/job/PreCommit-YARN-Build/17322/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/17322/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17322/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/17322/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        sunilg Sunil G added a comment -

        Updating patch as per offline comments from Vinod Kumar Vavilapalli.

        1. All user filter code moved to ClientRMService sothat filter code ll be applicable for CLI, REST and UI
        2. Introduced new config to control this feature
        Show
        sunilg Sunil G added a comment - Updating patch as per offline comments from Vinod Kumar Vavilapalli . All user filter code moved to ClientRMService sothat filter code ll be applicable for CLI, REST and UI Introduced new config to control this feature
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 15s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
              trunk Compile Tests
        0 mvndep 0m 11s Maven dependency ordering for branch
        +1 mvninstall 14m 4s trunk passed
        +1 compile 10m 25s trunk passed
        +1 checkstyle 1m 0s trunk passed
        +1 mvnsite 1m 51s trunk passed
        +1 findbugs 3m 18s trunk passed
        +1 javadoc 1m 21s trunk passed
              Patch Compile Tests
        0 mvndep 0m 10s Maven dependency ordering for patch
        +1 mvninstall 1m 27s the patch passed
        +1 compile 5m 55s the patch passed
        +1 javac 5m 55s the patch passed
        -0 checkstyle 1m 0s hadoop-yarn-project/hadoop-yarn: The patch generated 1 new + 291 unchanged - 0 fixed = 292 total (was 291)
        +1 mvnsite 1m 50s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 3m 42s the patch passed
        +1 javadoc 1m 16s the patch passed
              Other Tests
        -1 unit 0m 35s hadoop-yarn-api in the patch failed.
        +1 unit 1m 45s hadoop-yarn-server-common in the patch passed.
        -1 unit 47m 8s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 asflicense 0m 41s The patch does not generate ASF License warnings.
        106m 10s



        Reason Tests
        Failed junit tests hadoop.yarn.conf.TestYarnConfigurationFields
          hadoop.yarn.server.resourcemanager.TestRMAdminService
          hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:71bbb86
        JIRA Issue YARN-7157
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12886074/YARN-7157.002.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux dd5afd8f38d2 3.13.0-123-generic #172-Ubuntu SMP Mon Jun 26 18:04:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 5bbca80
        Default Java 1.8.0_144
        findbugs v3.1.0-RC1
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/17360/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17360/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/17360/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 15s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.       trunk Compile Tests 0 mvndep 0m 11s Maven dependency ordering for branch +1 mvninstall 14m 4s trunk passed +1 compile 10m 25s trunk passed +1 checkstyle 1m 0s trunk passed +1 mvnsite 1m 51s trunk passed +1 findbugs 3m 18s trunk passed +1 javadoc 1m 21s trunk passed       Patch Compile Tests 0 mvndep 0m 10s Maven dependency ordering for patch +1 mvninstall 1m 27s the patch passed +1 compile 5m 55s the patch passed +1 javac 5m 55s the patch passed -0 checkstyle 1m 0s hadoop-yarn-project/hadoop-yarn: The patch generated 1 new + 291 unchanged - 0 fixed = 292 total (was 291) +1 mvnsite 1m 50s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 42s the patch passed +1 javadoc 1m 16s the patch passed       Other Tests -1 unit 0m 35s hadoop-yarn-api in the patch failed. +1 unit 1m 45s hadoop-yarn-server-common in the patch passed. -1 unit 47m 8s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 41s The patch does not generate ASF License warnings. 106m 10s Reason Tests Failed junit tests hadoop.yarn.conf.TestYarnConfigurationFields   hadoop.yarn.server.resourcemanager.TestRMAdminService   hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation Subsystem Report/Notes Docker Image:yetus/hadoop:71bbb86 JIRA Issue YARN-7157 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12886074/YARN-7157.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux dd5afd8f38d2 3.13.0-123-generic #172-Ubuntu SMP Mon Jun 26 18:04:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 5bbca80 Default Java 1.8.0_144 findbugs v3.1.0-RC1 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/17360/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/17360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/17360/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17360/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/17360/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        sunilg Sunil G added a comment -

        As per the offline discussion with Rohith Sharma K S, I am removing the access check for users present in the user-filter list. This is used only for filtering, hence updated code only to handle all the ACL checks on callerUgi. Updated tests as well. Thank you Rohith Sharma K S for the quick findings

        Show
        sunilg Sunil G added a comment - As per the offline discussion with Rohith Sharma K S , I am removing the access check for users present in the user-filter list. This is used only for filtering, hence updated code only to handle all the ACL checks on callerUgi. Updated tests as well. Thank you Rohith Sharma K S for the quick findings
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 18s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
              trunk Compile Tests
        0 mvndep 0m 10s Maven dependency ordering for branch
        +1 mvninstall 12m 37s trunk passed
        +1 compile 8m 59s trunk passed
        +1 checkstyle 0m 49s trunk passed
        +1 mvnsite 1m 5s trunk passed
        +1 findbugs 1m 58s trunk passed
        +1 javadoc 0m 44s trunk passed
              Patch Compile Tests
        0 mvndep 0m 9s Maven dependency ordering for patch
        +1 mvninstall 0m 52s the patch passed
        +1 compile 5m 46s the patch passed
        +1 javac 5m 46s the patch passed
        -0 checkstyle 0m 50s hadoop-yarn-project/hadoop-yarn: The patch generated 1 new + 280 unchanged - 0 fixed = 281 total (was 280)
        +1 mvnsite 1m 7s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 2m 12s the patch passed
        +1 javadoc 0m 41s the patch passed
              Other Tests
        -1 unit 0m 31s hadoop-yarn-api in the patch failed.
        -1 unit 43m 42s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 asflicense 0m 22s The patch does not generate ASF License warnings.
        90m 40s



        Reason Tests
        Failed junit tests hadoop.yarn.conf.TestYarnConfigurationFields
          hadoop.yarn.server.resourcemanager.scheduler.TestAbstractYarnScheduler
          hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation
        Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestKillApplicationWithRMHA



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:71bbb86
        JIRA Issue YARN-7157
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12886369/YARN-7157.003.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 49ec5d39c3d9 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 5ab21df
        Default Java 1.8.0_144
        findbugs v3.1.0-RC1
        checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/17402/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17402/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17402/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17402/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/17402/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 18s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.       trunk Compile Tests 0 mvndep 0m 10s Maven dependency ordering for branch +1 mvninstall 12m 37s trunk passed +1 compile 8m 59s trunk passed +1 checkstyle 0m 49s trunk passed +1 mvnsite 1m 5s trunk passed +1 findbugs 1m 58s trunk passed +1 javadoc 0m 44s trunk passed       Patch Compile Tests 0 mvndep 0m 9s Maven dependency ordering for patch +1 mvninstall 0m 52s the patch passed +1 compile 5m 46s the patch passed +1 javac 5m 46s the patch passed -0 checkstyle 0m 50s hadoop-yarn-project/hadoop-yarn: The patch generated 1 new + 280 unchanged - 0 fixed = 281 total (was 280) +1 mvnsite 1m 7s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 2m 12s the patch passed +1 javadoc 0m 41s the patch passed       Other Tests -1 unit 0m 31s hadoop-yarn-api in the patch failed. -1 unit 43m 42s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 22s The patch does not generate ASF License warnings. 90m 40s Reason Tests Failed junit tests hadoop.yarn.conf.TestYarnConfigurationFields   hadoop.yarn.server.resourcemanager.scheduler.TestAbstractYarnScheduler   hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestKillApplicationWithRMHA Subsystem Report/Notes Docker Image:yetus/hadoop:71bbb86 JIRA Issue YARN-7157 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12886369/YARN-7157.003.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 49ec5d39c3d9 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 5ab21df Default Java 1.8.0_144 findbugs v3.1.0-RC1 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/17402/artifact/patchprocess/diff-checkstyle-hadoop-yarn-project_hadoop-yarn.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/17402/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/17402/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17402/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/17402/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        rohithsharma Rohith Sharma K S added a comment -

        +1 lgtm, I will commit it later if no more objections!

        Show
        rohithsharma Rohith Sharma K S added a comment - +1 lgtm, I will commit it later if no more objections!
        Hide
        rohithsharma Rohith Sharma K S added a comment -

        While committing the patch I found few conflicts. So I rebased the patch and reattaching to run jenkins

        Show
        rohithsharma Rohith Sharma K S added a comment - While committing the patch I found few conflicts. So I rebased the patch and reattaching to run jenkins
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 16m 0s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
              trunk Compile Tests
        0 mvndep 0m 10s Maven dependency ordering for branch
        +1 mvninstall 14m 48s trunk passed
        +1 compile 11m 41s trunk passed
        +1 checkstyle 1m 12s trunk passed
        +1 mvnsite 1m 35s trunk passed
        +1 findbugs 2m 55s trunk passed
        +1 javadoc 0m 59s trunk passed
              Patch Compile Tests
        0 mvndep 0m 13s Maven dependency ordering for patch
        +1 mvninstall 1m 20s the patch passed
        +1 compile 7m 36s the patch passed
        +1 javac 7m 36s the patch passed
        +1 checkstyle 1m 9s the patch passed
        +1 mvnsite 1m 31s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 3m 10s the patch passed
        +1 javadoc 0m 58s the patch passed
              Other Tests
        -1 unit 0m 40s hadoop-yarn-api in the patch failed.
        -1 unit 46m 41s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 asflicense 0m 27s The patch does not generate ASF License warnings.
        121m 25s



        Reason Tests
        Failed junit tests hadoop.yarn.conf.TestYarnConfigurationFields
          hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer
          hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation
          hadoop.yarn.server.resourcemanager.scheduler.TestAbstractYarnScheduler



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:71bbb86
        JIRA Issue YARN-7157
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12886823/YARN-7157.004.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux c93274623bfe 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / fa6cc43
        Default Java 1.8.0_144
        findbugs v3.1.0-RC1
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17434/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17434/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17434/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/17434/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 16m 0s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.       trunk Compile Tests 0 mvndep 0m 10s Maven dependency ordering for branch +1 mvninstall 14m 48s trunk passed +1 compile 11m 41s trunk passed +1 checkstyle 1m 12s trunk passed +1 mvnsite 1m 35s trunk passed +1 findbugs 2m 55s trunk passed +1 javadoc 0m 59s trunk passed       Patch Compile Tests 0 mvndep 0m 13s Maven dependency ordering for patch +1 mvninstall 1m 20s the patch passed +1 compile 7m 36s the patch passed +1 javac 7m 36s the patch passed +1 checkstyle 1m 9s the patch passed +1 mvnsite 1m 31s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 3m 10s the patch passed +1 javadoc 0m 58s the patch passed       Other Tests -1 unit 0m 40s hadoop-yarn-api in the patch failed. -1 unit 46m 41s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 27s The patch does not generate ASF License warnings. 121m 25s Reason Tests Failed junit tests hadoop.yarn.conf.TestYarnConfigurationFields   hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer   hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation   hadoop.yarn.server.resourcemanager.scheduler.TestAbstractYarnScheduler Subsystem Report/Notes Docker Image:yetus/hadoop:71bbb86 JIRA Issue YARN-7157 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12886823/YARN-7157.004.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux c93274623bfe 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / fa6cc43 Default Java 1.8.0_144 findbugs v3.1.0-RC1 unit https://builds.apache.org/job/PreCommit-YARN-Build/17434/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-api.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/17434/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17434/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/17434/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        sunilg Sunil G added a comment -

        Thanks Rohith Sharma K S.
        Attaching new patch after fixing test case failure.

        Show
        sunilg Sunil G added a comment - Thanks Rohith Sharma K S . Attaching new patch after fixing test case failure.
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Sunil G
        Thank you for providing patch.

        1. Can we think of grouping all the user level checks ? This would help in avoiding the additional filters.
        2. Found one whitespace error too while applying. Next patch please handle the same
        Show
        bibinchundatt Bibin A Chundatt added a comment - Sunil G Thank you for providing patch. Can we think of grouping all the user level checks ? This would help in avoiding the additional filters. Found one whitespace error too while applying. Next patch please handle the same
        Hide
        sunilg Sunil G added a comment -

        Thanks Bibin A Chundatt
        There are 2 aspects. One is user filter submitted from user side. This one is an admin filter. User filter need not have to check for access, as it just a contains check.

        Show
        sunilg Sunil G added a comment - Thanks Bibin A Chundatt There are 2 aspects. One is user filter submitted from user side. This one is an admin filter. User filter need not have to check for access, as it just a contains check.
        Hide
        bibinchundatt Bibin A Chundatt added a comment -

        Sunil G
        Looks like i didnt explain clearly.

              // checkAccess can grab the scheduler lock so call it last
              boolean allowAccess = checkAccess(callerUGI, application.getUser(),
                  ApplicationAccessType.VIEW_APP, application);
              if (scope == ApplicationsRequestScope.VIEWABLE && !allowAccess) {
                continue;
              }
        
              // Given RM is configured to display apps per user, skip apps to which
              // this caller doesn't have access to view.
              if (displayPerUserApps && !allowAccess) {
                continue;
              }
        

        Move this part of code higher in loop so that for normal WEBUI access could avoid lots of checks when displayPerUserApps is enabled.

        Show
        bibinchundatt Bibin A Chundatt added a comment - Sunil G Looks like i didnt explain clearly. // checkAccess can grab the scheduler lock so call it last boolean allowAccess = checkAccess(callerUGI, application.getUser(), ApplicationAccessType.VIEW_APP, application); if (scope == ApplicationsRequestScope.VIEWABLE && !allowAccess) { continue ; } // Given RM is configured to display apps per user, skip apps to which // this caller doesn't have access to view. if (displayPerUserApps && !allowAccess) { continue ; } Move this part of code higher in loop so that for normal WEBUI access could avoid lots of checks when displayPerUserApps is enabled.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 19s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
              trunk Compile Tests
        0 mvndep 0m 10s Maven dependency ordering for branch
        +1 mvninstall 14m 35s trunk passed
        +1 compile 9m 7s trunk passed
        +1 checkstyle 0m 59s trunk passed
        +1 mvnsite 1m 57s trunk passed
        +1 findbugs 3m 33s trunk passed
        +1 javadoc 1m 36s trunk passed
              Patch Compile Tests
        0 mvndep 0m 10s Maven dependency ordering for patch
        +1 mvninstall 1m 30s the patch passed
        +1 compile 5m 46s the patch passed
        +1 javac 5m 46s the patch passed
        +1 checkstyle 1m 0s the patch passed
        +1 mvnsite 1m 56s the patch passed
        -1 whitespace 0m 0s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
        +1 xml 0m 2s The patch has no ill-formed XML file.
        +1 findbugs 4m 10s the patch passed
        +1 javadoc 1m 36s the patch passed
              Other Tests
        +1 unit 0m 36s hadoop-yarn-api in the patch passed.
        +1 unit 2m 37s hadoop-yarn-common in the patch passed.
        -1 unit 46m 42s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 asflicense 0m 41s The patch does not generate ASF License warnings.
        107m 16s



        Reason Tests
        Failed junit tests hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation
          hadoop.yarn.server.resourcemanager.scheduler.TestAbstractYarnScheduler
        Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:71bbb86
        JIRA Issue YARN-7157
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12886839/YARN-7157.005.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux 637eb997f087 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / fa6cc43
        Default Java 1.8.0_144
        findbugs v3.1.0-RC1
        whitespace https://builds.apache.org/job/PreCommit-YARN-Build/17435/artifact/patchprocess/whitespace-eol.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17435/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17435/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/17435/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 19s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.       trunk Compile Tests 0 mvndep 0m 10s Maven dependency ordering for branch +1 mvninstall 14m 35s trunk passed +1 compile 9m 7s trunk passed +1 checkstyle 0m 59s trunk passed +1 mvnsite 1m 57s trunk passed +1 findbugs 3m 33s trunk passed +1 javadoc 1m 36s trunk passed       Patch Compile Tests 0 mvndep 0m 10s Maven dependency ordering for patch +1 mvninstall 1m 30s the patch passed +1 compile 5m 46s the patch passed +1 javac 5m 46s the patch passed +1 checkstyle 1m 0s the patch passed +1 mvnsite 1m 56s the patch passed -1 whitespace 0m 0s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply +1 xml 0m 2s The patch has no ill-formed XML file. +1 findbugs 4m 10s the patch passed +1 javadoc 1m 36s the patch passed       Other Tests +1 unit 0m 36s hadoop-yarn-api in the patch passed. +1 unit 2m 37s hadoop-yarn-common in the patch passed. -1 unit 46m 42s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 41s The patch does not generate ASF License warnings. 107m 16s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation   hadoop.yarn.server.resourcemanager.scheduler.TestAbstractYarnScheduler Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA Subsystem Report/Notes Docker Image:yetus/hadoop:71bbb86 JIRA Issue YARN-7157 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12886839/YARN-7157.005.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 637eb997f087 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / fa6cc43 Default Java 1.8.0_144 findbugs v3.1.0-RC1 whitespace https://builds.apache.org/job/PreCommit-YARN-Build/17435/artifact/patchprocess/whitespace-eol.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/17435/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17435/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/17435/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        sunilg Sunil G added a comment -

        Bibin A Chundatt.
        I have an additional thought here, checkAccess is slightly more costlier. So is it better to do all basic checks and get apps skipped as possible before checkAccess?

        Show
        sunilg Sunil G added a comment - Bibin A Chundatt . I have an additional thought here, checkAccess is slightly more costlier. So is it better to do all basic checks and get apps skipped as possible before checkAccess?
        Hide
        bibinchundatt Bibin A Chundatt added a comment - - edited

        Sunil G

        Aggree with the fact that checkAccess is costlier for first call for user. IIUC usergroups gets cached after the first call , correct me if i am wrong.
        Also to add completeness for per-user's feature shouldn't we handle in ATS and Jobhistory server too ?

        Show
        bibinchundatt Bibin A Chundatt added a comment - - edited Sunil G Aggree with the fact that checkAccess is costlier for first call for user . IIUC usergroups gets cached after the first call , correct me if i am wrong. Also to add completeness for per-user's feature shouldn't we handle in ATS and Jobhistory server too ?
        Hide
        sunilg Sunil G added a comment -

        Yes. For different calls, check ll be done again.
        I ll track them in separate jira. If this is fine, Rohith Sharma K S/Bibin A Chundatt please help to commit this.

        Show
        sunilg Sunil G added a comment - Yes. For different calls, check ll be done again. I ll track them in separate jira. If this is fine, Rohith Sharma K S / Bibin A Chundatt please help to commit this.
        Hide
        rohithsharma Rohith Sharma K S added a comment -

        Assuming no more comments, I am heading towards committing the patch shorlty!

        Show
        rohithsharma Rohith Sharma K S added a comment - Assuming no more comments, I am heading towards committing the patch shorlty!
        Hide
        rohithsharma Rohith Sharma K S added a comment -

        committed to trunk alone! Cherry-pick for branch-3 and branch-2 is failing. Sunil G Can you give branch-3/branch-2 patch for the same?

        Show
        rohithsharma Rohith Sharma K S added a comment - committed to trunk alone! Cherry-pick for branch-3 and branch-2 is failing. Sunil G Can you give branch-3/branch-2 patch for the same?
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12861 (See https://builds.apache.org/job/Hadoop-trunk-Commit/12861/)
        YARN-7157. Add admin configuration to filter per-user's apps in secure (rohithsharmaks: rev 5324388cf2357b1f80efd0c34392f577bf417455)

        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java
        • (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12861 (See https://builds.apache.org/job/Hadoop-trunk-Commit/12861/ ) YARN-7157 . Add admin configuration to filter per-user's apps in secure (rohithsharmaks: rev 5324388cf2357b1f80efd0c34392f577bf417455) (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestClientRMService.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
        Hide
        rohithsharma Rohith Sharma K S added a comment -

        On behalf of Sunil, I attached branch-2/branch-3 patches.

        Show
        rohithsharma Rohith Sharma K S added a comment - On behalf of Sunil, I attached branch-2/branch-3 patches.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 12m 1s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
              branch-2 Compile Tests
        0 mvndep 0m 25s Maven dependency ordering for branch
        +1 mvninstall 7m 5s branch-2 passed
        +1 compile 2m 20s branch-2 passed
        +1 checkstyle 0m 44s branch-2 passed
        +1 mvnsite 1m 41s branch-2 passed
        +1 findbugs 3m 41s branch-2 passed
        +1 javadoc 1m 17s branch-2 passed
              Patch Compile Tests
        0 mvndep 0m 10s Maven dependency ordering for patch
        -1 mvninstall 0m 30s hadoop-yarn-server-resourcemanager in the patch failed.
        -1 compile 1m 43s hadoop-yarn in the patch failed.
        -1 javac 1m 43s hadoop-yarn in the patch failed.
        +1 checkstyle 0m 42s the patch passed
        -1 mvnsite 0m 32s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 0s The patch has no ill-formed XML file.
        -1 findbugs 0m 21s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 javadoc 1m 14s the patch passed
              Other Tests
        +1 unit 0m 26s hadoop-yarn-api in the patch passed.
        +1 unit 2m 26s hadoop-yarn-common in the patch passed.
        -1 unit 0m 32s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 asflicense 0m 19s The patch does not generate ASF License warnings.
        50m 12s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:eaf5c66
        JIRA Issue YARN-7157
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887060/YARN-7157-branch-2.001.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux eb4dab24b233 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2 / eaef844
        Default Java 1.7.0_151
        findbugs v3.0.0
        mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/17472/artifact/patchprocess/patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        compile https://builds.apache.org/job/PreCommit-YARN-Build/17472/artifact/patchprocess/patch-compile-hadoop-yarn-project_hadoop-yarn.txt
        javac https://builds.apache.org/job/PreCommit-YARN-Build/17472/artifact/patchprocess/patch-compile-hadoop-yarn-project_hadoop-yarn.txt
        mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/17472/artifact/patchprocess/patch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        findbugs https://builds.apache.org/job/PreCommit-YARN-Build/17472/artifact/patchprocess/patch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17472/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17472/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/17472/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 12m 1s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.       branch-2 Compile Tests 0 mvndep 0m 25s Maven dependency ordering for branch +1 mvninstall 7m 5s branch-2 passed +1 compile 2m 20s branch-2 passed +1 checkstyle 0m 44s branch-2 passed +1 mvnsite 1m 41s branch-2 passed +1 findbugs 3m 41s branch-2 passed +1 javadoc 1m 17s branch-2 passed       Patch Compile Tests 0 mvndep 0m 10s Maven dependency ordering for patch -1 mvninstall 0m 30s hadoop-yarn-server-resourcemanager in the patch failed. -1 compile 1m 43s hadoop-yarn in the patch failed. -1 javac 1m 43s hadoop-yarn in the patch failed. +1 checkstyle 0m 42s the patch passed -1 mvnsite 0m 32s hadoop-yarn-server-resourcemanager in the patch failed. +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 0s The patch has no ill-formed XML file. -1 findbugs 0m 21s hadoop-yarn-server-resourcemanager in the patch failed. +1 javadoc 1m 14s the patch passed       Other Tests +1 unit 0m 26s hadoop-yarn-api in the patch passed. +1 unit 2m 26s hadoop-yarn-common in the patch passed. -1 unit 0m 32s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 19s The patch does not generate ASF License warnings. 50m 12s Subsystem Report/Notes Docker Image:yetus/hadoop:eaf5c66 JIRA Issue YARN-7157 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887060/YARN-7157-branch-2.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux eb4dab24b233 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2 / eaef844 Default Java 1.7.0_151 findbugs v3.0.0 mvninstall https://builds.apache.org/job/PreCommit-YARN-Build/17472/artifact/patchprocess/patch-mvninstall-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt compile https://builds.apache.org/job/PreCommit-YARN-Build/17472/artifact/patchprocess/patch-compile-hadoop-yarn-project_hadoop-yarn.txt javac https://builds.apache.org/job/PreCommit-YARN-Build/17472/artifact/patchprocess/patch-compile-hadoop-yarn-project_hadoop-yarn.txt mvnsite https://builds.apache.org/job/PreCommit-YARN-Build/17472/artifact/patchprocess/patch-mvnsite-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt findbugs https://builds.apache.org/job/PreCommit-YARN-Build/17472/artifact/patchprocess/patch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/17472/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17472/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/17472/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        sunilg Sunil G added a comment -

        Reattaching branch-3 patch

        Show
        sunilg Sunil G added a comment - Reattaching branch-3 patch
        Hide
        sunilg Sunil G added a comment -

        Attaching branch-2 patch as well.

        Show
        sunilg Sunil G added a comment - Attaching branch-2 patch as well.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 18s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
              branch-3.0 Compile Tests
        0 mvndep 3m 22s Maven dependency ordering for branch
        +1 mvninstall 14m 46s branch-3.0 passed
        +1 compile 9m 16s branch-3.0 passed
        +1 checkstyle 0m 51s branch-3.0 passed
        +1 mvnsite 1m 56s branch-3.0 passed
        +1 findbugs 3m 17s branch-3.0 passed
        +1 javadoc 1m 20s branch-3.0 passed
              Patch Compile Tests
        0 mvndep 0m 10s Maven dependency ordering for patch
        +1 mvninstall 1m 23s the patch passed
        +1 compile 5m 42s the patch passed
        +1 javac 5m 42s the patch passed
        +1 checkstyle 1m 2s the patch passed
        +1 mvnsite 1m 53s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 1s The patch has no ill-formed XML file.
        +1 findbugs 3m 44s the patch passed
        +1 javadoc 1m 16s the patch passed
              Other Tests
        +1 unit 0m 32s hadoop-yarn-api in the patch passed.
        +1 unit 2m 31s hadoop-yarn-common in the patch passed.
        -1 unit 45m 37s hadoop-yarn-server-resourcemanager in the patch failed.
        +1 asflicense 0m 28s The patch does not generate ASF License warnings.
        108m 42s



        Reason Tests
        Failed junit tests hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation
          hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:71bbb86
        JIRA Issue YARN-7157
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887263/YARN-7157-branch-3.0.002.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux d13eb28c001d 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-3.0 / a3d6ce2
        Default Java 1.8.0_144
        findbugs v3.1.0-RC1
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17475/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17475/testReport/
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/17475/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 18s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.       branch-3.0 Compile Tests 0 mvndep 3m 22s Maven dependency ordering for branch +1 mvninstall 14m 46s branch-3.0 passed +1 compile 9m 16s branch-3.0 passed +1 checkstyle 0m 51s branch-3.0 passed +1 mvnsite 1m 56s branch-3.0 passed +1 findbugs 3m 17s branch-3.0 passed +1 javadoc 1m 20s branch-3.0 passed       Patch Compile Tests 0 mvndep 0m 10s Maven dependency ordering for patch +1 mvninstall 1m 23s the patch passed +1 compile 5m 42s the patch passed +1 javac 5m 42s the patch passed +1 checkstyle 1m 2s the patch passed +1 mvnsite 1m 53s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 3m 44s the patch passed +1 javadoc 1m 16s the patch passed       Other Tests +1 unit 0m 32s hadoop-yarn-api in the patch passed. +1 unit 2m 31s hadoop-yarn-common in the patch passed. -1 unit 45m 37s hadoop-yarn-server-resourcemanager in the patch failed. +1 asflicense 0m 28s The patch does not generate ASF License warnings. 108m 42s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation   hadoop.yarn.server.resourcemanager.scheduler.fair.TestFSAppStarvation Subsystem Report/Notes Docker Image:yetus/hadoop:71bbb86 JIRA Issue YARN-7157 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887263/YARN-7157-branch-3.0.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux d13eb28c001d 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12 13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-3.0 / a3d6ce2 Default Java 1.8.0_144 findbugs v3.1.0-RC1 unit https://builds.apache.org/job/PreCommit-YARN-Build/17475/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17475/testReport/ modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/17475/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 12m 21s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
              branch-2 Compile Tests
        0 mvndep 0m 30s Maven dependency ordering for branch
        +1 mvninstall 6m 49s branch-2 passed
        +1 compile 2m 15s branch-2 passed
        +1 checkstyle 0m 44s branch-2 passed
        +1 mvnsite 1m 41s branch-2 passed
        +1 findbugs 3m 51s branch-2 passed
        +1 javadoc 1m 25s branch-2 passed
              Patch Compile Tests
        0 mvndep 0m 11s Maven dependency ordering for patch
        +1 mvninstall 1m 34s the patch passed
        +1 compile 2m 32s the patch passed
        +1 javac 2m 32s the patch passed
        +1 checkstyle 0m 44s the patch passed
        +1 mvnsite 1m 45s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 xml 0m 1s The patch has no ill-formed XML file.
        +1 findbugs 4m 24s the patch passed
        +1 javadoc 1m 19s the patch passed
              Other Tests
        +1 unit 0m 27s hadoop-yarn-api in the patch passed.
        +1 unit 2m 29s hadoop-yarn-common in the patch passed.
        -1 unit 91m 19s hadoop-yarn-server-resourcemanager in the patch failed.
        -1 asflicense 0m 40s The patch generated 1 ASF License warnings.
        144m 54s



        Reason Tests
        Failed junit tests hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesDelegationTokenAuthentication
          hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation
          hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesHttpStaticUserPermissions
          hadoop.yarn.server.resourcemanager.reservation.TestCapacityOverTimePolicy
          hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry
          hadoop.yarn.server.resourcemanager.webapp.TestRMWebappAuthentication
          hadoop.yarn.server.resourcemanager.TestApplicationACLs
          hadoop.yarn.server.resourcemanager.TestClientRMTokens
          hadoop.yarn.server.resourcemanager.TestRMRestart
          hadoop.yarn.server.resourcemanager.security.TestClientToAMTokens
          hadoop.yarn.server.resourcemanager.TestClientRMService
          hadoop.yarn.server.resourcemanager.resourcetracker.TestNMReconnect
          hadoop.yarn.server.resourcemanager.TestOpportunisticContainerAllocatorAMService
        Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestRMHA
          org.apache.hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore
          org.apache.hadoop.yarn.server.resourcemanager.TestRMAdminService



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:eaf5c66
        JIRA Issue YARN-7157
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887270/YARN-7157-branch-2.002.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
        uname Linux 8b5bf9b3d0ff 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2 / 317af87
        Default Java 1.7.0_151
        findbugs v3.0.0
        unit https://builds.apache.org/job/PreCommit-YARN-Build/17477/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
        Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17477/testReport/
        asflicense https://builds.apache.org/job/PreCommit-YARN-Build/17477/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn
        Console output https://builds.apache.org/job/PreCommit-YARN-Build/17477/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 12m 21s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.       branch-2 Compile Tests 0 mvndep 0m 30s Maven dependency ordering for branch +1 mvninstall 6m 49s branch-2 passed +1 compile 2m 15s branch-2 passed +1 checkstyle 0m 44s branch-2 passed +1 mvnsite 1m 41s branch-2 passed +1 findbugs 3m 51s branch-2 passed +1 javadoc 1m 25s branch-2 passed       Patch Compile Tests 0 mvndep 0m 11s Maven dependency ordering for patch +1 mvninstall 1m 34s the patch passed +1 compile 2m 32s the patch passed +1 javac 2m 32s the patch passed +1 checkstyle 0m 44s the patch passed +1 mvnsite 1m 45s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 4m 24s the patch passed +1 javadoc 1m 19s the patch passed       Other Tests +1 unit 0m 27s hadoop-yarn-api in the patch passed. +1 unit 2m 29s hadoop-yarn-common in the patch passed. -1 unit 91m 19s hadoop-yarn-server-resourcemanager in the patch failed. -1 asflicense 0m 40s The patch generated 1 ASF License warnings. 144m 54s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesDelegationTokenAuthentication   hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation   hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesHttpStaticUserPermissions   hadoop.yarn.server.resourcemanager.reservation.TestCapacityOverTimePolicy   hadoop.yarn.server.resourcemanager.resourcetracker.TestNMExpiry   hadoop.yarn.server.resourcemanager.webapp.TestRMWebappAuthentication   hadoop.yarn.server.resourcemanager.TestApplicationACLs   hadoop.yarn.server.resourcemanager.TestClientRMTokens   hadoop.yarn.server.resourcemanager.TestRMRestart   hadoop.yarn.server.resourcemanager.security.TestClientToAMTokens   hadoop.yarn.server.resourcemanager.TestClientRMService   hadoop.yarn.server.resourcemanager.resourcetracker.TestNMReconnect   hadoop.yarn.server.resourcemanager.TestOpportunisticContainerAllocatorAMService Timed out junit tests org.apache.hadoop.yarn.server.resourcemanager.TestRMHA   org.apache.hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore   org.apache.hadoop.yarn.server.resourcemanager.TestRMAdminService Subsystem Report/Notes Docker Image:yetus/hadoop:eaf5c66 JIRA Issue YARN-7157 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12887270/YARN-7157-branch-2.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 8b5bf9b3d0ff 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2 / 317af87 Default Java 1.7.0_151 findbugs v3.0.0 unit https://builds.apache.org/job/PreCommit-YARN-Build/17477/artifact/patchprocess/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/17477/testReport/ asflicense https://builds.apache.org/job/PreCommit-YARN-Build/17477/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn Console output https://builds.apache.org/job/PreCommit-YARN-Build/17477/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        rohithsharma Rohith Sharma K S added a comment -

        I have committed to branch-3.0 as well. Branch-2 patch has not run properly cc:/ Sunil G

        Show
        rohithsharma Rohith Sharma K S added a comment - I have committed to branch-3.0 as well. Branch-2 patch has not run properly cc:/ Sunil G

          People

          • Assignee:
            sunilg Sunil G
            Reporter:
            sunilg Sunil G
          • Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

            • Created:
              Updated:

              Development