Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
3.4.0
-
Reviewed
Description
WebHDFS should support getEcPolicies:
Attachments
Attachments
- image-2023-05-29-23-55-09-224.png
- 130 kB
- Hualong Zhang
Issue Links
- relates to
-
HDFS-17043 HttpFS implementation for getAllErasureCodingPolicies
- Resolved
- links to
Activity
Committed to trunk.
Thanx Hualong Zhang for the contribution, Tao Li and Shilun Fan for the reviews!!!
ayushtkn merged PR #5698:
URL: https://github.com/apache/hadoop/pull/5698
hadoop-yetus commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1576640616
:confetti_ball: *+1 overall*
Vote | Subsystem | Runtime | Logfile | Comment |
:----: | ----------: | --------: | :--------: | :-------: |
+0 :ok: | reexec | 0m 40s | Docker mode activated. | |
_ Prechecks _ | ||||
---|---|---|---|---|
+1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | |
+0 :ok: | codespell | 0m 1s | codespell was not available. | |
+0 :ok: | detsecrets | 0m 1s | detect-secrets was not available. | |
+0 :ok: | markdownlint | 0m 1s | markdownlint was not available. | |
+1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
+1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | |
_ trunk Compile Tests _ | ||||
+0 :ok: | mvndep | 16m 46s | Maven dependency ordering for branch | |
+1 :green_heart: | mvninstall | 21m 42s | trunk passed | |
+1 :green_heart: | compile | 5m 19s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | compile | 5m 10s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | checkstyle | 1m 19s | trunk passed | |
+1 :green_heart: | mvnsite | 2m 15s | trunk passed | |
+1 :green_heart: | javadoc | 1m 51s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 18s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 39s | trunk passed | |
+1 :green_heart: | shadedclient | 22m 29s | branch has no errors when building and testing our client artifacts. | |
_ Patch Compile Tests _ | ||||
+0 :ok: | mvndep | 0m 28s | Maven dependency ordering for patch | |
+1 :green_heart: | mvninstall | 1m 54s | the patch passed | |
+1 :green_heart: | compile | 5m 22s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javac | 5m 22s | the patch passed | |
+1 :green_heart: | compile | 5m 5s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | javac | 5m 5s | the patch passed | |
+1 :green_heart: | blanks | 0m 0s | The patch has no blanks issues. | |
+1 :green_heart: | checkstyle | 1m 6s | the patch passed | |
+1 :green_heart: | mvnsite | 2m 3s | the patch passed | |
+1 :green_heart: | javadoc | 1m 29s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 1s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 53s | the patch passed | |
+1 :green_heart: | shadedclient | 22m 36s | patch has no errors when building and testing our client artifacts. | |
_ Other Tests _ | ||||
+1 :green_heart: | unit | 2m 23s | hadoop-hdfs-client in the patch passed. | |
+1 :green_heart: | unit | 204m 48s | hadoop-hdfs in the patch passed. | |
+1 :green_heart: | asflicense | 0m 50s | The patch does not generate ASF License warnings. | |
341m 28s |
Subsystem | Report/Notes |
----------: | :------------- |
Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/9/artifact/out/Dockerfile |
GITHUB PR | https://github.com/apache/hadoop/pull/5698 |
Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint |
uname | Linux 15cace34682e 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | dev-support/bin/hadoop.sh |
git revision | trunk / 6f16f75efc93f58a606e140428ef94c93d12832c |
Default Java | Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/9/testReport/ |
Max. process+thread count | 3337 (vs. ulimit of 5500) |
modules | C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project |
Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/9/console |
versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 |
Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
hadoop-yetus commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1576563070
:broken_heart: *-1 overall*
Vote | Subsystem | Runtime | Logfile | Comment |
:----: | ----------: | --------: | :--------: | :-------: |
+0 :ok: | reexec | 0m 48s | Docker mode activated. | |
_ Prechecks _ | ||||
---|---|---|---|---|
+1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | |
+0 :ok: | codespell | 0m 1s | codespell was not available. | |
+0 :ok: | detsecrets | 0m 1s | detect-secrets was not available. | |
+0 :ok: | markdownlint | 0m 1s | markdownlint was not available. | |
+1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
+1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | |
_ trunk Compile Tests _ | ||||
+0 :ok: | mvndep | 16m 25s | Maven dependency ordering for branch | |
+1 :green_heart: | mvninstall | 22m 58s | trunk passed | |
+1 :green_heart: | compile | 5m 53s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | compile | 5m 36s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | checkstyle | 1m 19s | trunk passed | |
+1 :green_heart: | mvnsite | 2m 14s | trunk passed | |
+1 :green_heart: | javadoc | 1m 44s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 9s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 55s | trunk passed | |
+1 :green_heart: | shadedclient | 25m 55s | branch has no errors when building and testing our client artifacts. | |
_ Patch Compile Tests _ | ||||
+0 :ok: | mvndep | 0m 24s | Maven dependency ordering for patch | |
+1 :green_heart: | mvninstall | 1m 55s | the patch passed | |
+1 :green_heart: | compile | 5m 54s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javac | 5m 54s | the patch passed | |
+1 :green_heart: | compile | 5m 43s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | javac | 5m 43s | the patch passed | |
+1 :green_heart: | blanks | 0m 0s | The patch has no blanks issues. | |
+1 :green_heart: | checkstyle | 1m 9s | the patch passed | |
+1 :green_heart: | mvnsite | 2m 3s | the patch passed | |
+1 :green_heart: | javadoc | 1m 29s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 2s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 6m 32s | the patch passed | |
+1 :green_heart: | shadedclient | 26m 20s | patch has no errors when building and testing our client artifacts. | |
_ Other Tests _ | ||||
+1 :green_heart: | unit | 2m 26s | hadoop-hdfs-client in the patch passed. | |
-1 :x: | unit | 234m 22s | [/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/8/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt) | hadoop-hdfs in the patch passed. |
+1 :green_heart: | asflicense | 0m 51s | The patch does not generate ASF License warnings. | |
381m 10s |
Reason | Tests |
-------: | :------ |
Failed junit tests | hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes |
hadoop.hdfs.TestRollingUpgrade |
Subsystem | Report/Notes |
----------: | :------------- |
Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/8/artifact/out/Dockerfile |
GITHUB PR | https://github.com/apache/hadoop/pull/5698 |
Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint |
uname | Linux 168c6e0773b0 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | dev-support/bin/hadoop.sh |
git revision | trunk / 245391901d4cab2ac1b584191c7739db7b1b6fd2 |
Default Java | Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/8/testReport/ |
Max. process+thread count | 2349 (vs. ulimit of 5500) |
modules | C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project |
Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/8/console |
versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 |
Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
zhtttylz commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1575992353
@ayushtkn Would you mind to take another reviews? Thanks.
zhtttylz commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1575957222
@ayushtkn Would you mind to take another reviews? Thanks.
hadoop-yetus commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1575039937
:broken_heart: *-1 overall*
Vote | Subsystem | Runtime | Logfile | Comment |
:----: | ----------: | --------: | :--------: | :-------: |
+0 :ok: | reexec | 0m 50s | Docker mode activated. | |
_ Prechecks _ | ||||
---|---|---|---|---|
+1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | |
+0 :ok: | codespell | 0m 0s | codespell was not available. | |
+0 :ok: | detsecrets | 0m 0s | detect-secrets was not available. | |
+0 :ok: | markdownlint | 0m 0s | markdownlint was not available. | |
+1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
+1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | |
_ trunk Compile Tests _ | ||||
+0 :ok: | mvndep | 16m 16s | Maven dependency ordering for branch | |
+1 :green_heart: | mvninstall | 22m 15s | trunk passed | |
+1 :green_heart: | compile | 5m 51s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | compile | 5m 30s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | checkstyle | 1m 20s | trunk passed | |
+1 :green_heart: | mvnsite | 2m 11s | trunk passed | |
+1 :green_heart: | javadoc | 1m 46s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 7s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 6m 3s | trunk passed | |
+1 :green_heart: | shadedclient | 25m 42s | branch has no errors when building and testing our client artifacts. | |
_ Patch Compile Tests _ | ||||
+0 :ok: | mvndep | 0m 24s | Maven dependency ordering for patch | |
+1 :green_heart: | mvninstall | 1m 53s | the patch passed | |
+1 :green_heart: | compile | 5m 50s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javac | 5m 50s | the patch passed | |
+1 :green_heart: | compile | 5m 31s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | javac | 5m 31s | the patch passed | |
+1 :green_heart: | blanks | 0m 0s | The patch has no blanks issues. | |
+1 :green_heart: | checkstyle | 1m 8s | the patch passed | |
+1 :green_heart: | mvnsite | 1m 59s | the patch passed | |
+1 :green_heart: | javadoc | 1m 28s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 1m 58s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 54s | the patch passed | |
+1 :green_heart: | shadedclient | 25m 37s | patch has no errors when building and testing our client artifacts. | |
_ Other Tests _ | ||||
+1 :green_heart: | unit | 2m 17s | hadoop-hdfs-client in the patch passed. | |
-1 :x: | unit | 226m 19s | [/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/7/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt) | hadoop-hdfs in the patch passed. |
+1 :green_heart: | asflicense | 0m 42s | The patch does not generate ASF License warnings. | |
370m 5s |
Reason | Tests |
-------: | :------ |
Failed junit tests | hadoop.hdfs.server.datanode.TestDirectoryScanner |
hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes |
Subsystem | Report/Notes |
----------: | :------------- |
Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/7/artifact/out/Dockerfile |
GITHUB PR | https://github.com/apache/hadoop/pull/5698 |
Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint |
uname | Linux 273a72188ac4 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | dev-support/bin/hadoop.sh |
git revision | trunk / 245391901d4cab2ac1b584191c7739db7b1b6fd2 |
Default Java | Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/7/testReport/ |
Max. process+thread count | 2418 (vs. ulimit of 5500) |
modules | C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project |
Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/7/console |
versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 |
Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
hadoop-yetus commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1574974880
:broken_heart: *-1 overall*
Vote | Subsystem | Runtime | Logfile | Comment |
:----: | ----------: | --------: | :--------: | :-------: |
+0 :ok: | reexec | 0m 35s | Docker mode activated. | |
_ Prechecks _ | ||||
---|---|---|---|---|
+1 :green_heart: | dupname | 0m 1s | No case conflicting files found. | |
+0 :ok: | codespell | 0m 1s | codespell was not available. | |
+0 :ok: | detsecrets | 0m 1s | detect-secrets was not available. | |
+0 :ok: | markdownlint | 0m 1s | markdownlint was not available. | |
+1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
+1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | |
_ trunk Compile Tests _ | ||||
+0 :ok: | mvndep | 16m 42s | Maven dependency ordering for branch | |
+1 :green_heart: | mvninstall | 19m 42s | trunk passed | |
+1 :green_heart: | compile | 5m 22s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | compile | 5m 0s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | checkstyle | 1m 20s | trunk passed | |
+1 :green_heart: | mvnsite | 2m 13s | trunk passed | |
+1 :green_heart: | javadoc | 1m 49s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 18s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 40s | trunk passed | |
+1 :green_heart: | shadedclient | 22m 32s | branch has no errors when building and testing our client artifacts. | |
_ Patch Compile Tests _ | ||||
+0 :ok: | mvndep | 0m 29s | Maven dependency ordering for patch | |
+1 :green_heart: | mvninstall | 1m 51s | the patch passed | |
+1 :green_heart: | compile | 5m 6s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javac | 5m 6s | the patch passed | |
+1 :green_heart: | compile | 4m 58s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | javac | 4m 59s | the patch passed | |
+1 :green_heart: | blanks | 0m 0s | The patch has no blanks issues. | |
+1 :green_heart: | checkstyle | 1m 7s | the patch passed | |
+1 :green_heart: | mvnsite | 1m 58s | the patch passed | |
+1 :green_heart: | javadoc | 1m 28s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 1m 59s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 36s | the patch passed | |
+1 :green_heart: | shadedclient | 22m 18s | patch has no errors when building and testing our client artifacts. | |
_ Other Tests _ | ||||
+1 :green_heart: | unit | 2m 23s | hadoop-hdfs-client in the patch passed. | |
-1 :x: | unit | 129m 38s | [/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/6/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt) | hadoop-hdfs in the patch passed. |
+0 :ok: | asflicense | 0m 36s | ASF License check generated no output? | |
262m 33s |
Reason | Tests |
-------: | :------ |
Failed junit tests | hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps |
hadoop.hdfs.server.namenode.TestQuotaWithStripedBlocksWithRandomECPolicy | |
hadoop.hdfs.server.namenode.TestNamenodeRetryCache | |
hadoop.hdfs.server.namenode.TestDecommissioningStatusWithBackoffMonitor | |
hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics | |
hadoop.hdfs.server.namenode.TestFSDirectory | |
hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd |
Subsystem | Report/Notes |
----------: | :------------- |
Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/6/artifact/out/Dockerfile |
GITHUB PR | https://github.com/apache/hadoop/pull/5698 |
Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint |
uname | Linux ad55929e9f2f 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | dev-support/bin/hadoop.sh |
git revision | trunk / 245391901d4cab2ac1b584191c7739db7b1b6fd2 |
Default Java | Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/6/testReport/ |
Max. process+thread count | 3700 (vs. ulimit of 5500) |
modules | C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project |
Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/6/console |
versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 |
Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
zhtttylz commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1574850956
> @ayushtkn Thank you very much for helping to review the code! @zhtttylz Thanks for your contribution! please modify the code as suggested by ayushtkn.
Thank you very much for your valuable suggestion. I will make the necessary modifications to the code as soon as possible
slfan1989 commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1574822951
@ayushtkn Thank you very much for helping to review the code! @zhtttylz Thanks for your contribution! please modify the code as suggested by ayushtkn.
hadoop-yetus commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1574366925
:broken_heart: *-1 overall*
Vote | Subsystem | Runtime | Logfile | Comment |
:----: | ----------: | --------: | :--------: | :-------: |
+0 :ok: | reexec | 0m 49s | Docker mode activated. | |
_ Prechecks _ | ||||
---|---|---|---|---|
+1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | |
+0 :ok: | codespell | 0m 1s | codespell was not available. | |
+0 :ok: | detsecrets | 0m 1s | detect-secrets was not available. | |
+0 :ok: | markdownlint | 0m 1s | markdownlint was not available. | |
+1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
+1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | |
_ trunk Compile Tests _ | ||||
+0 :ok: | mvndep | 19m 19s | Maven dependency ordering for branch | |
+1 :green_heart: | mvninstall | 22m 45s | trunk passed | |
+1 :green_heart: | compile | 5m 59s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | compile | 5m 39s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | checkstyle | 1m 18s | trunk passed | |
+1 :green_heart: | mvnsite | 2m 11s | trunk passed | |
+1 :green_heart: | javadoc | 1m 44s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 9s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 6m 0s | trunk passed | |
+1 :green_heart: | shadedclient | 25m 51s | branch has no errors when building and testing our client artifacts. | |
_ Patch Compile Tests _ | ||||
+0 :ok: | mvndep | 0m 23s | Maven dependency ordering for patch | |
+1 :green_heart: | mvninstall | 1m 55s | the patch passed | |
+1 :green_heart: | compile | 5m 48s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javac | 5m 48s | the patch passed | |
+1 :green_heart: | compile | 5m 32s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | javac | 5m 32s | the patch passed | |
+1 :green_heart: | blanks | 0m 0s | The patch has no blanks issues. | |
-0 :warning: | checkstyle | 1m 7s | [/results-checkstyle-hadoop-hdfs-project.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/5/artifact/out/results-checkstyle-hadoop-hdfs-project.txt) | hadoop-hdfs-project: The patch generated 1 new + 147 unchanged - 0 fixed = 148 total (was 147) |
+1 :green_heart: | mvnsite | 2m 1s | the patch passed | |
+1 :green_heart: | javadoc | 1m 27s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 1m 56s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 56s | the patch passed | |
+1 :green_heart: | shadedclient | 25m 55s | patch has no errors when building and testing our client artifacts. | |
_ Other Tests _ | ||||
+1 :green_heart: | unit | 2m 16s | hadoop-hdfs-client in the patch passed. | |
-1 :x: | unit | 229m 47s | [/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/5/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt) | hadoop-hdfs in the patch passed. |
+1 :green_heart: | asflicense | 0m 42s | The patch does not generate ASF License warnings. | |
377m 44s |
Reason | Tests |
-------: | :------ |
Failed junit tests | hadoop.hdfs.server.namenode.ha.TestObserverNode |
hadoop.hdfs.server.datanode.TestDirectoryScanner |
Subsystem | Report/Notes |
----------: | :------------- |
Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/5/artifact/out/Dockerfile |
GITHUB PR | https://github.com/apache/hadoop/pull/5698 |
Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint |
uname | Linux 4f9a92610db4 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | dev-support/bin/hadoop.sh |
git revision | trunk / d165cd5ebded6cc150672730223d4946bb6fecd5 |
Default Java | Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/5/testReport/ |
Max. process+thread count | 2140 (vs. ulimit of 5500) |
modules | C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project |
Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/5/console |
versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 |
Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
zhtttylz commented on code in PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#discussion_r1213978842
##########
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java:
##########
@@ -2291,6 +2291,36 @@ public void testFsStatus() throws Exception {
}
}
+ @Test
+ public void testGetErasureCodingPolicies() throws Exception {
+ final Configuration conf = WebHdfsTestUtil.createConf();
+ try {
+ cluster = new MiniDFSCluster.Builder(conf).build();
+ cluster.waitActive();
+
+ final WebHdfsFileSystem webHdfs =
+ WebHdfsTestUtil.getWebHdfsFileSystem(conf,
+ WebHdfsConstants.WEBHDFS_SCHEME);
+
+ final DistributedFileSystem dfs = cluster.getFileSystem();
+
+ Collection<ErasureCodingPolicyInfo> webHdfsEcPolicyInfos =
+ webHdfs.getAllErasureCodingPolicies();
+
+ Collection<ErasureCodingPolicyInfo> dfsEcPolicyInfos =
+ dfs.getAllErasureCodingPolicies();
+
+ //Validate erasureCodingPolicyInfos are the same as DistributedFileSystem
+ boolean isEqual = webHdfsEcPolicyInfos.stream()
+ .allMatch(dfsEcPolicyInfos::contains) &&
+ dfsEcPolicyInfos.stream()
+ .allMatch(webHdfsEcPolicyInfos::contains);
+ assertTrue(isEqual);
Review Comment:
Thank you for your valuable suggestion. I greatly appreciate it and will promptly make the necessary changes to the code!
ayushtkn commented on code in PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#discussion_r1213973691
##########
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java:
##########
@@ -2291,6 +2291,36 @@ public void testFsStatus() throws Exception {
}
}
+ @Test
+ public void testGetErasureCodingPolicies() throws Exception {
+ final Configuration conf = WebHdfsTestUtil.createConf();
+ try {
+ cluster = new MiniDFSCluster.Builder(conf).build();
+ cluster.waitActive();
+
+ final WebHdfsFileSystem webHdfs =
+ WebHdfsTestUtil.getWebHdfsFileSystem(conf,
+ WebHdfsConstants.WEBHDFS_SCHEME);
+
+ final DistributedFileSystem dfs = cluster.getFileSystem();
+
+ Collection<ErasureCodingPolicyInfo> webHdfsEcPolicyInfos =
+ webHdfs.getAllErasureCodingPolicies();
+
+ Collection<ErasureCodingPolicyInfo> dfsEcPolicyInfos =
+ dfs.getAllErasureCodingPolicies();
+
+ //Validate erasureCodingPolicyInfos are the same as DistributedFileSystem
+ boolean isEqual = webHdfsEcPolicyInfos.stream()
+ .allMatch(dfsEcPolicyInfos::contains) &&
+ dfsEcPolicyInfos.stream()
+ .allMatch(webHdfsEcPolicyInfos::contains);
+ assertTrue(isEqual);
Review Comment:
Can we do this instead
```
//Validate erasureCodingPolicyInfos are the same as DistributedFileSystem
assertEquals(dfsEcPolicyInfos.size(), webHdfsEcPolicyInfos.size());
assertTrue(dfsEcPolicyInfos.containsAll(webHdfsEcPolicyInfos));
```
ayushtkn commented on code in PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#discussion_r1213971976
##########
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java:
##########
@@ -2291,6 +2291,36 @@ public void testFsStatus() throws Exception {
}
}
+ @Test
+ public void testGetErasureCodingPolicies() throws Exception {
+ final Configuration conf = WebHdfsTestUtil.createConf();
+ try {
+ cluster = new MiniDFSCluster.Builder(conf).build();
Review Comment:
pull this line above try, else if this line fails your finally will throw NPE.
slfan1989 commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1573052639
> @ayushtkn @slfan1989 Would you be so kind as to review my pull request, please? Thank you very much!
@ayushtkn Can you help review this pr? Thank you very much!
hadoop-yetus commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1570384537
:broken_heart: *-1 overall*
Vote | Subsystem | Runtime | Logfile | Comment |
:----: | ----------: | --------: | :--------: | :-------: |
+0 :ok: | reexec | 0m 35s | Docker mode activated. | |
_ Prechecks _ | ||||
---|---|---|---|---|
+1 :green_heart: | dupname | 0m 1s | No case conflicting files found. | |
+0 :ok: | codespell | 0m 0s | codespell was not available. | |
+0 :ok: | detsecrets | 0m 0s | detect-secrets was not available. | |
+0 :ok: | markdownlint | 0m 0s | markdownlint was not available. | |
+1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
+1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | |
_ trunk Compile Tests _ | ||||
+0 :ok: | mvndep | 16m 4s | Maven dependency ordering for branch | |
+1 :green_heart: | mvninstall | 21m 37s | trunk passed | |
+1 :green_heart: | compile | 5m 22s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | compile | 5m 4s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | checkstyle | 1m 18s | trunk passed | |
+1 :green_heart: | mvnsite | 2m 13s | trunk passed | |
+1 :green_heart: | javadoc | 1m 50s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 15s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 41s | trunk passed | |
+1 :green_heart: | shadedclient | 22m 28s | branch has no errors when building and testing our client artifacts. | |
_ Patch Compile Tests _ | ||||
+0 :ok: | mvndep | 0m 29s | Maven dependency ordering for patch | |
+1 :green_heart: | mvninstall | 1m 49s | the patch passed | |
+1 :green_heart: | compile | 5m 1s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javac | 5m 1s | the patch passed | |
+1 :green_heart: | compile | 4m 55s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | javac | 4m 55s | the patch passed | |
+1 :green_heart: | blanks | 0m 0s | The patch has no blanks issues. | |
+1 :green_heart: | checkstyle | 1m 7s | the patch passed | |
+1 :green_heart: | mvnsite | 1m 59s | the patch passed | |
+1 :green_heart: | javadoc | 1m 25s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 0s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 30s | the patch passed | |
+1 :green_heart: | shadedclient | 22m 29s | patch has no errors when building and testing our client artifacts. | |
_ Other Tests _ | ||||
+1 :green_heart: | unit | 2m 22s | hadoop-hdfs-client in the patch passed. | |
-1 :x: | unit | 202m 35s | [/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/4/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt) | hadoop-hdfs in the patch passed. |
+1 :green_heart: | asflicense | 0m 51s | The patch does not generate ASF License warnings. | |
336m 56s |
Reason | Tests |
-------: | :------ |
Failed junit tests | hadoop.hdfs.server.datanode.TestDirectoryScanner |
Subsystem | Report/Notes |
----------: | :------------- |
Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/4/artifact/out/Dockerfile |
GITHUB PR | https://github.com/apache/hadoop/pull/5698 |
Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint |
uname | Linux d32fd60ca720 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | dev-support/bin/hadoop.sh |
git revision | trunk / d51741415c7061e50a6bcb257a04bcf228fbcc91 |
Default Java | Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/4/testReport/ |
Max. process+thread count | 3599 (vs. ulimit of 5500) |
modules | C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project |
Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/4/console |
versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 |
Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
zhtttylz commented on code in PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#discussion_r1211341558
##########
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java:
##########
@@ -741,4 +741,27 @@ public static Map<String, Object> toJsonMap(FsStatus status)
+
+ public static Map<String, Object> toJsonMap(ErasureCodingPolicyInfo ecPolicyInfo) {
+ if (ecPolicyInfo == null)
+ Map<String, Object> m = new HashMap<>();
+ m.put("policy", ecPolicyInfo.getPolicy());
+ m.put("state", ecPolicyInfo.getState());
+ return m;
+ }
+
+ public static String toJsonString(ErasureCodingPolicyInfo[] ecPolicyInfos) {
+ final Map<String, Object> erasureCodingPolicies = new TreeMap<>();
Review Comment:
Thank you for your valuable suggestion. Since sorting of keys is not required, it's unnecessary to use `TreeMap`. I sincerely appreciate it and will promptly implement the required adjustments to the code!
slfan1989 commented on code in PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#discussion_r1211125291
##########
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/JsonUtil.java:
##########
@@ -741,4 +741,27 @@ public static Map<String, Object> toJsonMap(FsStatus status)
+
+ public static Map<String, Object> toJsonMap(ErasureCodingPolicyInfo ecPolicyInfo) {
+ if (ecPolicyInfo == null)
+ Map<String, Object> m = new HashMap<>();
+ m.put("policy", ecPolicyInfo.getPolicy());
+ m.put("state", ecPolicyInfo.getState());
+ return m;
+ }
+
+ public static String toJsonString(ErasureCodingPolicyInfo[] ecPolicyInfos) {
+ final Map<String, Object> erasureCodingPolicies = new TreeMap<>();
Review Comment:
Why TreeMap?
zhtttylz commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1569437949
@ayushtkn @slfan1989 Would you be so kind as to review my pull request, please? Thank you very much!
hadoop-yetus commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1568101799
:broken_heart: *-1 overall*
Vote | Subsystem | Runtime | Logfile | Comment |
:----: | ----------: | --------: | :--------: | :-------: |
+0 :ok: | reexec | 0m 33s | Docker mode activated. | |
_ Prechecks _ | ||||
---|---|---|---|---|
+1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | |
+0 :ok: | codespell | 0m 0s | codespell was not available. | |
+0 :ok: | detsecrets | 0m 0s | detect-secrets was not available. | |
+0 :ok: | markdownlint | 0m 0s | markdownlint was not available. | |
+1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
+1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | |
_ trunk Compile Tests _ | ||||
+0 :ok: | mvndep | 18m 9s | Maven dependency ordering for branch | |
+1 :green_heart: | mvninstall | 20m 0s | trunk passed | |
+1 :green_heart: | compile | 5m 17s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | compile | 5m 4s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | checkstyle | 1m 18s | trunk passed | |
+1 :green_heart: | mvnsite | 2m 14s | trunk passed | |
+1 :green_heart: | javadoc | 1m 50s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 12s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 40s | trunk passed | |
+1 :green_heart: | shadedclient | 22m 7s | branch has no errors when building and testing our client artifacts. | |
_ Patch Compile Tests _ | ||||
+0 :ok: | mvndep | 0m 28s | Maven dependency ordering for patch | |
+1 :green_heart: | mvninstall | 1m 51s | the patch passed | |
+1 :green_heart: | compile | 5m 8s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javac | 5m 8s | the patch passed | |
+1 :green_heart: | compile | 4m 58s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | javac | 4m 58s | the patch passed | |
+1 :green_heart: | blanks | 0m 0s | The patch has no blanks issues. | |
+1 :green_heart: | checkstyle | 1m 3s | the patch passed | |
+1 :green_heart: | mvnsite | 1m 57s | the patch passed | |
+1 :green_heart: | javadoc | 1m 28s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 1m 58s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 34s | the patch passed | |
+1 :green_heart: | shadedclient | 22m 25s | patch has no errors when building and testing our client artifacts. | |
_ Other Tests _ | ||||
+1 :green_heart: | unit | 2m 21s | hadoop-hdfs-client in the patch passed. | |
-1 :x: | unit | 204m 1s | [/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/3/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt) | hadoop-hdfs in the patch passed. |
+1 :green_heart: | asflicense | 0m 50s | The patch does not generate ASF License warnings. | |
338m 17s |
Reason | Tests |
-------: | :------ |
Failed junit tests | hadoop.hdfs.server.datanode.TestDirectoryScanner |
Subsystem | Report/Notes |
----------: | :------------- |
Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/3/artifact/out/Dockerfile |
GITHUB PR | https://github.com/apache/hadoop/pull/5698 |
Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint |
uname | Linux d94b6588acdc 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | dev-support/bin/hadoop.sh |
git revision | trunk / eeb9f5ab15d6b6179fba901625be6d708e8059b0 |
Default Java | Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/3/testReport/ |
Max. process+thread count | 3310 (vs. ulimit of 5500) |
modules | C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project |
Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/3/console |
versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 |
Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
hadoop-yetus commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1567618221
:broken_heart: *-1 overall*
Vote | Subsystem | Runtime | Logfile | Comment |
:----: | ----------: | --------: | :--------: | :-------: |
+0 :ok: | reexec | 0m 47s | Docker mode activated. | |
_ Prechecks _ | ||||
---|---|---|---|---|
+1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | |
+0 :ok: | codespell | 0m 0s | codespell was not available. | |
+0 :ok: | detsecrets | 0m 0s | detect-secrets was not available. | |
+0 :ok: | markdownlint | 0m 0s | markdownlint was not available. | |
+1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
+1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | |
_ trunk Compile Tests _ | ||||
+0 :ok: | mvndep | 15m 59s | Maven dependency ordering for branch | |
+1 :green_heart: | mvninstall | 22m 39s | trunk passed | |
+1 :green_heart: | compile | 5m 53s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | compile | 5m 50s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | checkstyle | 1m 19s | trunk passed | |
+1 :green_heart: | mvnsite | 2m 10s | trunk passed | |
+1 :green_heart: | javadoc | 1m 46s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 7s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 55s | trunk passed | |
+1 :green_heart: | shadedclient | 25m 47s | branch has no errors when building and testing our client artifacts. | |
_ Patch Compile Tests _ | ||||
+0 :ok: | mvndep | 0m 23s | Maven dependency ordering for patch | |
+1 :green_heart: | mvninstall | 1m 53s | the patch passed | |
+1 :green_heart: | compile | 5m 46s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javac | 5m 46s | the patch passed | |
+1 :green_heart: | compile | 5m 31s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | javac | 5m 31s | the patch passed | |
-1 :x: | blanks | 0m 0s | [/blanks-tabs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/1/artifact/out/blanks-tabs.txt) | The patch 21 line(s) with tabs. |
+1 :green_heart: | checkstyle | 1m 8s | the patch passed | |
+1 :green_heart: | mvnsite | 1m 58s | the patch passed | |
+1 :green_heart: | javadoc | 1m 27s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 1m 56s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 6m 1s | the patch passed | |
+1 :green_heart: | shadedclient | 25m 48s | patch has no errors when building and testing our client artifacts. | |
_ Other Tests _ | ||||
+1 :green_heart: | unit | 2m 18s | hadoop-hdfs-client in the patch passed. | |
-1 :x: | unit | 222m 29s | [/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/1/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt) | hadoop-hdfs in the patch passed. |
+1 :green_heart: | asflicense | 0m 43s | The patch does not generate ASF License warnings. | |
366m 56s |
Reason | Tests |
-------: | :------ |
Failed junit tests | hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl |
Subsystem | Report/Notes |
----------: | :------------- |
Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/1/artifact/out/Dockerfile |
GITHUB PR | https://github.com/apache/hadoop/pull/5698 |
Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint |
uname | Linux 61145132b14a 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | dev-support/bin/hadoop.sh |
git revision | trunk / e7a5de299277cb82b7af3e8dd98e8eba2c760042 |
Default Java | Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/1/testReport/ |
Max. process+thread count | 2375 (vs. ulimit of 5500) |
modules | C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project |
Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/1/console |
versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 |
Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
hadoop-yetus commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1567607695
:broken_heart: *-1 overall*
Vote | Subsystem | Runtime | Logfile | Comment |
:----: | ----------: | --------: | :--------: | :-------: |
+0 :ok: | reexec | 0m 35s | Docker mode activated. | |
_ Prechecks _ | ||||
---|---|---|---|---|
+1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | |
+0 :ok: | codespell | 0m 0s | codespell was not available. | |
+0 :ok: | detsecrets | 0m 0s | detect-secrets was not available. | |
+0 :ok: | markdownlint | 0m 0s | markdownlint was not available. | |
+1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | |
+1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | |
_ trunk Compile Tests _ | ||||
+0 :ok: | mvndep | 16m 13s | Maven dependency ordering for branch | |
+1 :green_heart: | mvninstall | 19m 34s | trunk passed | |
+1 :green_heart: | compile | 5m 16s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | compile | 5m 7s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | checkstyle | 1m 18s | trunk passed | |
+1 :green_heart: | mvnsite | 2m 14s | trunk passed | |
+1 :green_heart: | javadoc | 1m 51s | trunk passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 15s | trunk passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 39s | trunk passed | |
+1 :green_heart: | shadedclient | 22m 15s | branch has no errors when building and testing our client artifacts. | |
_ Patch Compile Tests _ | ||||
+0 :ok: | mvndep | 0m 29s | Maven dependency ordering for patch | |
+1 :green_heart: | mvninstall | 1m 51s | the patch passed | |
+1 :green_heart: | compile | 5m 11s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javac | 5m 11s | the patch passed | |
+1 :green_heart: | compile | 4m 59s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | javac | 4m 59s | the patch passed | |
-1 :x: | blanks | 0m 0s | [/blanks-tabs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/2/artifact/out/blanks-tabs.txt) | The patch 21 line(s) with tabs. |
+1 :green_heart: | checkstyle | 1m 4s | the patch passed | |
+1 :green_heart: | mvnsite | 1m 58s | the patch passed | |
+1 :green_heart: | javadoc | 1m 25s | the patch passed with JDK Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 | |
+1 :green_heart: | javadoc | 2m 0s | the patch passed with JDK Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 | |
+1 :green_heart: | spotbugs | 5m 36s | the patch passed | |
+1 :green_heart: | shadedclient | 22m 45s | patch has no errors when building and testing our client artifacts. | |
_ Other Tests _ | ||||
+1 :green_heart: | unit | 2m 23s | hadoop-hdfs-client in the patch passed. | |
-1 :x: | unit | 205m 52s | [/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/2/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt) | hadoop-hdfs in the patch passed. |
+1 :green_heart: | asflicense | 0m 51s | The patch does not generate ASF License warnings. | |
338m 36s |
Reason | Tests |
-------: | :------ |
Failed junit tests | hadoop.hdfs.server.datanode.TestDirectoryScanner |
Subsystem | Report/Notes |
----------: | :------------- |
Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/2/artifact/out/Dockerfile |
GITHUB PR | https://github.com/apache/hadoop/pull/5698 |
Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets markdownlint |
uname | Linux af992b769903 4.15.0-206-generic #217-Ubuntu SMP Fri Feb 3 19:10:13 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | dev-support/bin/hadoop.sh |
git revision | trunk / e9888bc5a66e1c38effdd872dcf29d23c63ad69d |
Default Java | Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.19+7-post-Ubuntu-0ubuntu120.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_362-8u372-ga~us1-0ubuntu1~20.04-b09 |
Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/2/testReport/ |
Max. process+thread count | 3529 (vs. ulimit of 5500) |
modules | C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project |
Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5698/2/console |
versions | git=2.25.1 maven=3.6.3 spotbugs=4.2.2 |
Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
zhtttylz opened a new pull request, #5698:
URL: https://github.com/apache/hadoop/pull/5698
JIRA: HDFS-17029. Support getECPolices API in WebHDFS
zhtttylz commented on PR #5698:
URL: https://github.com/apache/hadoop/pull/5698#issuecomment-1576778150
@ayushtkn @slfan1989 @tomscut Thank you for your assistance in reviewing the code!