Details

    • Sub-task
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • api, capacityscheduler, client
    • None

    Description

      This jira focusses on supporting mapping of Nodes to Attributes through REST

      Attachments

        1. YARN-6857-YARN-3409.001.patch
          22 kB
          Naganarasimha G R
        2. YARN-6857.002.patch
          33 kB
          Bilwa S T
        3. YARN-6857.003.patch
          32 kB
          Bilwa S T

        Issue Links

          Activity

            WIP patch for the REST modifications

            Naganarasimha Naganarasimha G R added a comment - WIP patch for the REST modifications
            prabhujoseph Prabhu Joseph added a comment -

            Naganarasimha Would like to have these changes in Hadoop, please let us know if BilwaST and me can do the remaining work on this if you are fine. Thanks.

            prabhujoseph Prabhu Joseph added a comment - Naganarasimha Would like to have these changes in Hadoop, please let us know if BilwaST and me can do the remaining work on this if you are fine. Thanks.

            prabhujoseph, Glad that you and bilwa_st  can take it forward, please go ahead and assign it to yourself!

            Naganarasimha Naganarasimha G R added a comment - prabhujoseph , Glad that you and bilwa_st   can take it forward, please go ahead and assign it to yourself!
            prabhujoseph Prabhu Joseph added a comment -

            Thanks Naganarasimha.

            prabhujoseph Prabhu Joseph added a comment - Thanks Naganarasimha .
            BilwaST Bilwa S T added a comment -

            Thanks Naganarasimha.

            prabhujoseph I have attached patch. Please review

            BilwaST Bilwa S T added a comment - Thanks Naganarasimha . prabhujoseph I have attached patch. Please review
            hadoopqa Hadoop QA added a comment -
            -1 overall



            Vote Subsystem Runtime Comment
            0 reexec 1m 26s Docker mode activated.
                  Prechecks
            +1 dupname 0m 0s No case conflicting files found.
            +1 @author 0m 0s The patch does not contain any @author tags.
            +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
                  trunk Compile Tests
            +1 mvninstall 23m 42s trunk passed
            +1 compile 1m 5s trunk passed
            +1 checkstyle 0m 44s trunk passed
            +1 mvnsite 1m 6s trunk passed
            +1 shadedclient 18m 21s branch has no errors when building and testing our client artifacts.
            +1 javadoc 0m 32s trunk passed
            0 spotbugs 1m 47s Used deprecated FindBugs config; considering switching to SpotBugs.
            +1 findbugs 1m 46s trunk passed
                  Patch Compile Tests
            +1 mvninstall 0m 47s the patch passed
            +1 compile 0m 44s the patch passed
            +1 javac 0m 44s the patch passed
            -0 checkstyle 0m 32s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 5 new + 12 unchanged - 0 fixed = 17 total (was 12)
            +1 mvnsite 0m 45s the patch passed
            +1 whitespace 0m 0s The patch has no whitespace issues.
            +1 shadedclient 15m 20s patch has no errors when building and testing our client artifacts.
            +1 javadoc 0m 29s the patch passed
            +1 findbugs 1m 49s the patch passed
                  Other Tests
            -1 unit 91m 36s hadoop-yarn-server-resourcemanager in the patch passed.
            +1 asflicense 0m 29s The patch does not generate ASF License warnings.
            160m 49s



            Reason Tests
            Failed junit tests hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes



            Subsystem Report/Notes
            Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/PreCommit-YARN-Build/26113/artifact/out/Dockerfile
            JIRA Issue YARN-6857
            JIRA Patch URL https://issues.apache.org/jira/secure/attachment/13004821/YARN-6857.002.patch
            Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle
            uname Linux 251c07ae8064 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
            Build tool maven
            Personality personality/hadoop.sh
            git revision trunk / 5157118bd7f
            Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
            checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/26113/artifact/out/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
            unit https://builds.apache.org/job/PreCommit-YARN-Build/26113/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
            Test Results https://builds.apache.org/job/PreCommit-YARN-Build/26113/testReport/
            Max. process+thread count 829 (vs. ulimit of 5500)
            modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
            Console output https://builds.apache.org/job/PreCommit-YARN-Build/26113/console
            versions git=2.17.1 maven=3.6.0 findbugs=3.1.0-RC1
            Powered by Apache Yetus 0.12.0 https://yetus.apache.org

            This message was automatically generated.

            hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 1m 26s Docker mode activated.       Prechecks +1 dupname 0m 0s No case conflicting files found. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.       trunk Compile Tests +1 mvninstall 23m 42s trunk passed +1 compile 1m 5s trunk passed +1 checkstyle 0m 44s trunk passed +1 mvnsite 1m 6s trunk passed +1 shadedclient 18m 21s branch has no errors when building and testing our client artifacts. +1 javadoc 0m 32s trunk passed 0 spotbugs 1m 47s Used deprecated FindBugs config; considering switching to SpotBugs. +1 findbugs 1m 46s trunk passed       Patch Compile Tests +1 mvninstall 0m 47s the patch passed +1 compile 0m 44s the patch passed +1 javac 0m 44s the patch passed -0 checkstyle 0m 32s hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 5 new + 12 unchanged - 0 fixed = 17 total (was 12) +1 mvnsite 0m 45s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 shadedclient 15m 20s patch has no errors when building and testing our client artifacts. +1 javadoc 0m 29s the patch passed +1 findbugs 1m 49s the patch passed       Other Tests -1 unit 91m 36s hadoop-yarn-server-resourcemanager in the patch passed. +1 asflicense 0m 29s The patch does not generate ASF License warnings. 160m 49s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes Subsystem Report/Notes Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/PreCommit-YARN-Build/26113/artifact/out/Dockerfile JIRA Issue YARN-6857 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/13004821/YARN-6857.002.patch Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle uname Linux 251c07ae8064 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality personality/hadoop.sh git revision trunk / 5157118bd7f Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09 checkstyle https://builds.apache.org/job/PreCommit-YARN-Build/26113/artifact/out/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt unit https://builds.apache.org/job/PreCommit-YARN-Build/26113/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/26113/testReport/ Max. process+thread count 829 (vs. ulimit of 5500) modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Console output https://builds.apache.org/job/PreCommit-YARN-Build/26113/console versions git=2.17.1 maven=3.6.0 findbugs=3.1.0-RC1 Powered by Apache Yetus 0.12.0 https://yetus.apache.org This message was automatically generated.
            BilwaST Bilwa S T added a comment -

            Fixed checkstyle and UT

            BilwaST Bilwa S T added a comment - Fixed checkstyle and UT
            hadoopqa Hadoop QA added a comment -
            -1 overall



            Vote Subsystem Runtime Comment
            0 reexec 1m 22s Docker mode activated.
                  Prechecks
            +1 dupname 0m 1s No case conflicting files found.
            +1 @author 0m 0s The patch does not contain any @author tags.
            +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
                  trunk Compile Tests
            +1 mvninstall 21m 34s trunk passed
            +1 compile 0m 47s trunk passed
            +1 checkstyle 0m 35s trunk passed
            +1 mvnsite 0m 51s trunk passed
            +1 shadedclient 16m 56s branch has no errors when building and testing our client artifacts.
            +1 javadoc 0m 31s trunk passed
            0 spotbugs 1m 41s Used deprecated FindBugs config; considering switching to SpotBugs.
            +1 findbugs 1m 39s trunk passed
                  Patch Compile Tests
            +1 mvninstall 0m 47s the patch passed
            +1 compile 0m 41s the patch passed
            +1 javac 0m 41s the patch passed
            +1 checkstyle 0m 30s the patch passed
            +1 mvnsite 0m 44s the patch passed
            +1 whitespace 0m 0s The patch has no whitespace issues.
            +1 shadedclient 15m 19s patch has no errors when building and testing our client artifacts.
            +1 javadoc 0m 28s the patch passed
            +1 findbugs 1m 42s the patch passed
                  Other Tests
            -1 unit 91m 17s hadoop-yarn-server-resourcemanager in the patch passed.
            +1 asflicense 0m 28s The patch does not generate ASF License warnings.
            156m 8s



            Reason Tests
            Failed junit tests hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer
              hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerPreemption



            Subsystem Report/Notes
            Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/PreCommit-YARN-Build/26114/artifact/out/Dockerfile
            JIRA Issue YARN-6857
            JIRA Patch URL https://issues.apache.org/jira/secure/attachment/13004844/YARN-6857.003.patch
            Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle
            uname Linux 7dc6b4b9cafc 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
            Build tool maven
            Personality personality/hadoop.sh
            git revision trunk / 5157118bd7f
            Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
            unit https://builds.apache.org/job/PreCommit-YARN-Build/26114/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
            Test Results https://builds.apache.org/job/PreCommit-YARN-Build/26114/testReport/
            Max. process+thread count 816 (vs. ulimit of 5500)
            modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
            Console output https://builds.apache.org/job/PreCommit-YARN-Build/26114/console
            versions git=2.17.1 maven=3.6.0 findbugs=3.1.0-RC1
            Powered by Apache Yetus 0.12.0 https://yetus.apache.org

            This message was automatically generated.

            hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 1m 22s Docker mode activated.       Prechecks +1 dupname 0m 1s No case conflicting files found. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.       trunk Compile Tests +1 mvninstall 21m 34s trunk passed +1 compile 0m 47s trunk passed +1 checkstyle 0m 35s trunk passed +1 mvnsite 0m 51s trunk passed +1 shadedclient 16m 56s branch has no errors when building and testing our client artifacts. +1 javadoc 0m 31s trunk passed 0 spotbugs 1m 41s Used deprecated FindBugs config; considering switching to SpotBugs. +1 findbugs 1m 39s trunk passed       Patch Compile Tests +1 mvninstall 0m 47s the patch passed +1 compile 0m 41s the patch passed +1 javac 0m 41s the patch passed +1 checkstyle 0m 30s the patch passed +1 mvnsite 0m 44s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 shadedclient 15m 19s patch has no errors when building and testing our client artifacts. +1 javadoc 0m 28s the patch passed +1 findbugs 1m 42s the patch passed       Other Tests -1 unit 91m 17s hadoop-yarn-server-resourcemanager in the patch passed. +1 asflicense 0m 28s The patch does not generate ASF License warnings. 156m 8s Reason Tests Failed junit tests hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer   hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerPreemption Subsystem Report/Notes Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/PreCommit-YARN-Build/26114/artifact/out/Dockerfile JIRA Issue YARN-6857 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/13004844/YARN-6857.003.patch Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle uname Linux 7dc6b4b9cafc 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality personality/hadoop.sh git revision trunk / 5157118bd7f Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09 unit https://builds.apache.org/job/PreCommit-YARN-Build/26114/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt Test Results https://builds.apache.org/job/PreCommit-YARN-Build/26114/testReport/ Max. process+thread count 816 (vs. ulimit of 5500) modules C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Console output https://builds.apache.org/job/PreCommit-YARN-Build/26114/console versions git=2.17.1 maven=3.6.0 findbugs=3.1.0-RC1 Powered by Apache Yetus 0.12.0 https://yetus.apache.org This message was automatically generated.
            prabhujoseph Prabhu Joseph added a comment -

            BilwaST Thanks for the patch, i will take some time to test and review the patch. Will update you.

            prabhujoseph Prabhu Joseph added a comment - BilwaST Thanks for the patch, i will take some time to test and review the patch. Will update you.

            People

              BilwaST Bilwa S T
              Naganarasimha Naganarasimha G R
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: