Details
-
Sub-task
-
Status: Patch Available
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
This jira focusses on supporting mapping of Nodes to Attributes through REST
Attachments
Attachments
- YARN-6857-YARN-3409.001.patch
- 22 kB
- Naganarasimha G R
- YARN-6857.002.patch
- 33 kB
- Bilwa S T
- YARN-6857.003.patch
- 32 kB
- Bilwa S T
Issue Links
- is duplicated by
-
YARN-10181 Managing Centralized Node Attribute via RMWebServices.
- Resolved
Activity
Prabhu Joseph
added a comment -
Naganarasimha Would like to have these changes in Hadoop, please let us know if BilwaST and me can do the remaining work on this if you are fine. Thanks.
Prabhu Joseph
added a comment - Naganarasimha Would like to have these changes in Hadoop, please let us know if BilwaST and me can do the remaining work on this if you are fine. Thanks.
Naganarasimha G R
added a comment -
prabhujoseph, Glad that you and bilwa_st can take it forward, please go ahead and assign it to yourself!
Naganarasimha G R
added a comment - prabhujoseph , Glad that you and bilwa_st can take it forward, please go ahead and assign it to yourself!
Prabhu Joseph
added a comment - Thanks Naganarasimha .
Bilwa S T
added a comment - Thanks Naganarasimha .
prabhujoseph I have attached patch. Please review
Hadoop QA
added a comment -
-1 overall |
Vote | Subsystem | Runtime | Comment |
---|---|---|---|
0 | reexec | 1m 26s | Docker mode activated. |
Prechecks | |||
+1 | dupname | 0m 0s | No case conflicting files found. |
+1 | @author | 0m 0s | The patch does not contain any @author tags. |
+1 | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. |
trunk Compile Tests | |||
+1 | mvninstall | 23m 42s | trunk passed |
+1 | compile | 1m 5s | trunk passed |
+1 | checkstyle | 0m 44s | trunk passed |
+1 | mvnsite | 1m 6s | trunk passed |
+1 | shadedclient | 18m 21s | branch has no errors when building and testing our client artifacts. |
+1 | javadoc | 0m 32s | trunk passed |
0 | spotbugs | 1m 47s | Used deprecated FindBugs config; considering switching to SpotBugs. |
+1 | findbugs | 1m 46s | trunk passed |
Patch Compile Tests | |||
+1 | mvninstall | 0m 47s | the patch passed |
+1 | compile | 0m 44s | the patch passed |
+1 | javac | 0m 44s | the patch passed |
-0 | checkstyle | 0m 32s | hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 5 new + 12 unchanged - 0 fixed = 17 total (was 12) |
+1 | mvnsite | 0m 45s | the patch passed |
+1 | whitespace | 0m 0s | The patch has no whitespace issues. |
+1 | shadedclient | 15m 20s | patch has no errors when building and testing our client artifacts. |
+1 | javadoc | 0m 29s | the patch passed |
+1 | findbugs | 1m 49s | the patch passed |
Other Tests | |||
-1 | unit | 91m 36s | hadoop-yarn-server-resourcemanager in the patch passed. |
+1 | asflicense | 0m 29s | The patch does not generate ASF License warnings. |
160m 49s |
Reason | Tests |
---|---|
Failed junit tests | hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes |
Subsystem | Report/Notes |
---|---|
Docker | ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/PreCommit-YARN-Build/26113/artifact/out/Dockerfile |
JIRA Issue | YARN-6857 |
JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/13004821/YARN-6857.002.patch |
Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle |
uname | Linux 251c07ae8064 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | personality/hadoop.sh |
git revision | trunk / 5157118bd7f |
Default Java | Private Build-1.8.0_252-8u252-b09-1~18.04-b09 |
checkstyle | https://builds.apache.org/job/PreCommit-YARN-Build/26113/artifact/out/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt |
unit | https://builds.apache.org/job/PreCommit-YARN-Build/26113/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt |
Test Results | https://builds.apache.org/job/PreCommit-YARN-Build/26113/testReport/ |
Max. process+thread count | 829 (vs. ulimit of 5500) |
modules | C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager |
Console output | https://builds.apache.org/job/PreCommit-YARN-Build/26113/console |
versions | git=2.17.1 maven=3.6.0 findbugs=3.1.0-RC1 |
Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
This message was automatically generated.
Hadoop QA
added a comment -
-1 overall
Vote
Subsystem
Runtime
Comment
0
reexec
1m 26s
Docker mode activated.
Prechecks
+1
dupname
0m 0s
No case conflicting files found.
+1
@author
0m 0s
The patch does not contain any @author tags.
+1
test4tests
0m 0s
The patch appears to include 1 new or modified test files.
trunk Compile Tests
+1
mvninstall
23m 42s
trunk passed
+1
compile
1m 5s
trunk passed
+1
checkstyle
0m 44s
trunk passed
+1
mvnsite
1m 6s
trunk passed
+1
shadedclient
18m 21s
branch has no errors when building and testing our client artifacts.
+1
javadoc
0m 32s
trunk passed
0
spotbugs
1m 47s
Used deprecated FindBugs config; considering switching to SpotBugs.
+1
findbugs
1m 46s
trunk passed
Patch Compile Tests
+1
mvninstall
0m 47s
the patch passed
+1
compile
0m 44s
the patch passed
+1
javac
0m 44s
the patch passed
-0
checkstyle
0m 32s
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: The patch generated 5 new + 12 unchanged - 0 fixed = 17 total (was 12)
+1
mvnsite
0m 45s
the patch passed
+1
whitespace
0m 0s
The patch has no whitespace issues.
+1
shadedclient
15m 20s
patch has no errors when building and testing our client artifacts.
+1
javadoc
0m 29s
the patch passed
+1
findbugs
1m 49s
the patch passed
Other Tests
-1
unit
91m 36s
hadoop-yarn-server-resourcemanager in the patch passed.
+1
asflicense
0m 29s
The patch does not generate ASF License warnings.
160m 49s
Reason
Tests
Failed junit tests
hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesNodes
Subsystem
Report/Notes
Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/PreCommit-YARN-Build/26113/artifact/out/Dockerfile
JIRA Issue
YARN-6857
JIRA Patch URL
https://issues.apache.org/jira/secure/attachment/13004821/YARN-6857.002.patch
Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle
uname
Linux 251c07ae8064 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool
maven
Personality
personality/hadoop.sh
git revision
trunk / 5157118bd7f
Default Java
Private Build-1.8.0_252-8u252-b09-1~18.04-b09
checkstyle
https://builds.apache.org/job/PreCommit-YARN-Build/26113/artifact/out/diff-checkstyle-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
unit
https://builds.apache.org/job/PreCommit-YARN-Build/26113/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
Test Results
https://builds.apache.org/job/PreCommit-YARN-Build/26113/testReport/
Max. process+thread count
829 (vs. ulimit of 5500)
modules
C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
Console output
https://builds.apache.org/job/PreCommit-YARN-Build/26113/console
versions
git=2.17.1 maven=3.6.0 findbugs=3.1.0-RC1
Powered by
Apache Yetus 0.12.0 https://yetus.apache.org
This message was automatically generated.
Bilwa S T
added a comment - Fixed checkstyle and UT
Hadoop QA
added a comment -
-1 overall |
Vote | Subsystem | Runtime | Comment |
---|---|---|---|
0 | reexec | 1m 22s | Docker mode activated. |
Prechecks | |||
+1 | dupname | 0m 1s | No case conflicting files found. |
+1 | @author | 0m 0s | The patch does not contain any @author tags. |
+1 | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. |
trunk Compile Tests | |||
+1 | mvninstall | 21m 34s | trunk passed |
+1 | compile | 0m 47s | trunk passed |
+1 | checkstyle | 0m 35s | trunk passed |
+1 | mvnsite | 0m 51s | trunk passed |
+1 | shadedclient | 16m 56s | branch has no errors when building and testing our client artifacts. |
+1 | javadoc | 0m 31s | trunk passed |
0 | spotbugs | 1m 41s | Used deprecated FindBugs config; considering switching to SpotBugs. |
+1 | findbugs | 1m 39s | trunk passed |
Patch Compile Tests | |||
+1 | mvninstall | 0m 47s | the patch passed |
+1 | compile | 0m 41s | the patch passed |
+1 | javac | 0m 41s | the patch passed |
+1 | checkstyle | 0m 30s | the patch passed |
+1 | mvnsite | 0m 44s | the patch passed |
+1 | whitespace | 0m 0s | The patch has no whitespace issues. |
+1 | shadedclient | 15m 19s | patch has no errors when building and testing our client artifacts. |
+1 | javadoc | 0m 28s | the patch passed |
+1 | findbugs | 1m 42s | the patch passed |
Other Tests | |||
-1 | unit | 91m 17s | hadoop-yarn-server-resourcemanager in the patch passed. |
+1 | asflicense | 0m 28s | The patch does not generate ASF License warnings. |
156m 8s |
Reason | Tests |
---|---|
Failed junit tests | hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer |
hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerPreemption |
Subsystem | Report/Notes |
---|---|
Docker | ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/PreCommit-YARN-Build/26114/artifact/out/Dockerfile |
JIRA Issue | YARN-6857 |
JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/13004844/YARN-6857.003.patch |
Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle |
uname | Linux 7dc6b4b9cafc 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | personality/hadoop.sh |
git revision | trunk / 5157118bd7f |
Default Java | Private Build-1.8.0_252-8u252-b09-1~18.04-b09 |
unit | https://builds.apache.org/job/PreCommit-YARN-Build/26114/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt |
Test Results | https://builds.apache.org/job/PreCommit-YARN-Build/26114/testReport/ |
Max. process+thread count | 816 (vs. ulimit of 5500) |
modules | C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager |
Console output | https://builds.apache.org/job/PreCommit-YARN-Build/26114/console |
versions | git=2.17.1 maven=3.6.0 findbugs=3.1.0-RC1 |
Powered by | Apache Yetus 0.12.0 https://yetus.apache.org |
This message was automatically generated.
Hadoop QA
added a comment -
-1 overall
Vote
Subsystem
Runtime
Comment
0
reexec
1m 22s
Docker mode activated.
Prechecks
+1
dupname
0m 1s
No case conflicting files found.
+1
@author
0m 0s
The patch does not contain any @author tags.
+1
test4tests
0m 0s
The patch appears to include 1 new or modified test files.
trunk Compile Tests
+1
mvninstall
21m 34s
trunk passed
+1
compile
0m 47s
trunk passed
+1
checkstyle
0m 35s
trunk passed
+1
mvnsite
0m 51s
trunk passed
+1
shadedclient
16m 56s
branch has no errors when building and testing our client artifacts.
+1
javadoc
0m 31s
trunk passed
0
spotbugs
1m 41s
Used deprecated FindBugs config; considering switching to SpotBugs.
+1
findbugs
1m 39s
trunk passed
Patch Compile Tests
+1
mvninstall
0m 47s
the patch passed
+1
compile
0m 41s
the patch passed
+1
javac
0m 41s
the patch passed
+1
checkstyle
0m 30s
the patch passed
+1
mvnsite
0m 44s
the patch passed
+1
whitespace
0m 0s
The patch has no whitespace issues.
+1
shadedclient
15m 19s
patch has no errors when building and testing our client artifacts.
+1
javadoc
0m 28s
the patch passed
+1
findbugs
1m 42s
the patch passed
Other Tests
-1
unit
91m 17s
hadoop-yarn-server-resourcemanager in the patch passed.
+1
asflicense
0m 28s
The patch does not generate ASF License warnings.
156m 8s
Reason
Tests
Failed junit tests
hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer
hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerPreemption
Subsystem
Report/Notes
Docker
ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/PreCommit-YARN-Build/26114/artifact/out/Dockerfile
JIRA Issue
YARN-6857
JIRA Patch URL
https://issues.apache.org/jira/secure/attachment/13004844/YARN-6857.003.patch
Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle
uname
Linux 7dc6b4b9cafc 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool
maven
Personality
personality/hadoop.sh
git revision
trunk / 5157118bd7f
Default Java
Private Build-1.8.0_252-8u252-b09-1~18.04-b09
unit
https://builds.apache.org/job/PreCommit-YARN-Build/26114/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
Test Results
https://builds.apache.org/job/PreCommit-YARN-Build/26114/testReport/
Max. process+thread count
816 (vs. ulimit of 5500)
modules
C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager
Console output
https://builds.apache.org/job/PreCommit-YARN-Build/26114/console
versions
git=2.17.1 maven=3.6.0 findbugs=3.1.0-RC1
Powered by
Apache Yetus 0.12.0 https://yetus.apache.org
This message was automatically generated.
Prabhu Joseph
added a comment -
BilwaST Thanks for the patch, i will take some time to test and review the patch. Will update you.
Prabhu Joseph
added a comment - BilwaST Thanks for the patch, i will take some time to test and review the patch. Will update you.
WIP patch for the REST modifications