Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11280

Allow WebHDFS to reuse HTTP connections to NN

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.7.3, 2.6.5, 3.0.0-alpha1
    • Fix Version/s: 2.8.0, 2.7.4, 3.0.0-alpha2
    • Component/s: hdfs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      WebHDFSClient calls "conn.disconnect()", which disconnects from the NameNode. When we use webhdfs as the source in distcp, this used up all ephemeral ports on the client side since all closed connections continue to occupy the port with TIME_WAIT status for some time.

      According to http://tinyurl.com/java7-http-keepalive, we should call conn.getInputStream().close() instead to make sure the connection is kept alive. This will get rid of the ephemeral port problem.

      Manual steps used to verify the bug fix:
      1. Build original hadoop jar.
      2. Try out distcp from webhdfs as source, and "netstat -n | grep TIME_WAIT | grep -c 50070" on the local machine shows a big number (100s).
      3. Build hadoop jar with this diff.
      4. Try out distcp from webhdfs as source, and "netstat -n | grep TIME_WAIT | grep -c 50070" on the local machine shows 0.
      5. The explanation: distcp's client side does a lot of directory scanning, which would create and close a lot of connections to the namenode HTTP port.

      Reference:
      2.7 and below: https://github.com/apache/hadoop/blob/branch-2.6/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java#L743

      2.8 and above: https://github.com/apache/hadoop/blob/branch-2.8/hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java#L898

      1. HDFS-11280.for.2.8.and.beyond.patch
        0.9 kB
        Zheng Shao
      2. HDFS-11280.for.2.8.and.beyond.5.patch
        2 kB
        Zheng Shao
      3. HDFS-11280.for.2.8.and.beyond.4.patch
        2 kB
        Zheng Shao
      4. HDFS-11280.for.2.8.and.beyond.3.patch
        2 kB
        Zheng Shao
      5. HDFS-11280.for.2.8.and.beyond.2.patch
        0.8 kB
        Zheng Shao
      6. HDFS-11280.for.2.7.and.below.patch
        0.9 kB
        Zheng Shao

        Activity

        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 0s Docker mode activated.
        -1 patch 0m 6s HDFS-11280 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.



        Subsystem Report/Notes
        JIRA Issue HDFS-11280
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845006/HDFS-11280.for.2.7.and.below.patch
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17979/console
        Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. -1 patch 0m 6s HDFS-11280 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. Subsystem Report/Notes JIRA Issue HDFS-11280 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845006/HDFS-11280.for.2.7.and.below.patch Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17979/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 0s Docker mode activated.
        -1 patch 0m 5s HDFS-11280 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.



        Subsystem Report/Notes
        JIRA Issue HDFS-11280
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845093/HDFS-11280.for.2.8.and.beyond.patch
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17986/console
        Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. -1 patch 0m 5s HDFS-11280 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. Subsystem Report/Notes JIRA Issue HDFS-11280 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845093/HDFS-11280.for.2.8.and.beyond.patch Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17986/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        wheat9 Haohui Mai added a comment -

        Zheng Shao, thanks for reporting the bug. Would you mind rebasing the patch to trunk?

        Show
        wheat9 Haohui Mai added a comment - Zheng Shao , thanks for reporting the bug. Would you mind rebasing the patch to trunk?
        Hide
        wheat9 Haohui Mai added a comment -

        The bug can potentially bring down the NN if users are doing a large-scale distcp over webhdfs.

        Show
        wheat9 Haohui Mai added a comment - The bug can potentially bring down the NN if users are doing a large-scale distcp over webhdfs.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 13s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 mvninstall 14m 18s trunk passed
        +1 compile 0m 35s trunk passed
        +1 checkstyle 0m 17s trunk passed
        +1 mvnsite 0m 40s trunk passed
        +1 mvneclipse 0m 14s trunk passed
        +1 findbugs 1m 40s trunk passed
        +1 javadoc 0m 24s trunk passed
        +1 mvninstall 0m 41s the patch passed
        +1 compile 0m 31s the patch passed
        +1 javac 0m 31s the patch passed
        +1 checkstyle 0m 12s the patch passed
        +1 mvnsite 0m 35s the patch passed
        +1 mvneclipse 0m 10s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        -1 findbugs 1m 45s hadoop-hdfs-project/hadoop-hdfs-client generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
        +1 javadoc 0m 17s the patch passed
        +1 unit 1m 0s hadoop-hdfs-client in the patch passed.
        +1 asflicense 0m 18s The patch does not generate ASF License warnings.
        25m 11s



        Reason Tests
        FindBugs module:hadoop-hdfs-project/hadoop-hdfs-client
          Redundant nullcheck of is, which is known to be non-null in org.apache.hadoop.hdfs.web.WebHdfsFileSystem$FsPathResponseRunner.getResponse(HttpURLConnection) Redundant null check at WebHdfsFileSystem.java:is known to be non-null in org.apache.hadoop.hdfs.web.WebHdfsFileSystem$FsPathResponseRunner.getResponse(HttpURLConnection) Redundant null check at WebHdfsFileSystem.java:[line 897]



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:a9ad5d6
        JIRA Issue HDFS-11280
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845110/HDFS-11280.for.2.8.and.beyond.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 93fa081b4102 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 95c2c24
        Default Java 1.8.0_111
        findbugs v3.0.0
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/17988/artifact/patchprocess/new-findbugs-hadoop-hdfs-project_hadoop-hdfs-client.html
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/17988/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs-client U: hadoop-hdfs-project/hadoop-hdfs-client
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17988/console
        Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 13s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 14m 18s trunk passed +1 compile 0m 35s trunk passed +1 checkstyle 0m 17s trunk passed +1 mvnsite 0m 40s trunk passed +1 mvneclipse 0m 14s trunk passed +1 findbugs 1m 40s trunk passed +1 javadoc 0m 24s trunk passed +1 mvninstall 0m 41s the patch passed +1 compile 0m 31s the patch passed +1 javac 0m 31s the patch passed +1 checkstyle 0m 12s the patch passed +1 mvnsite 0m 35s the patch passed +1 mvneclipse 0m 10s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. -1 findbugs 1m 45s hadoop-hdfs-project/hadoop-hdfs-client generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0) +1 javadoc 0m 17s the patch passed +1 unit 1m 0s hadoop-hdfs-client in the patch passed. +1 asflicense 0m 18s The patch does not generate ASF License warnings. 25m 11s Reason Tests FindBugs module:hadoop-hdfs-project/hadoop-hdfs-client   Redundant nullcheck of is, which is known to be non-null in org.apache.hadoop.hdfs.web.WebHdfsFileSystem$FsPathResponseRunner.getResponse(HttpURLConnection) Redundant null check at WebHdfsFileSystem.java:is known to be non-null in org.apache.hadoop.hdfs.web.WebHdfsFileSystem$FsPathResponseRunner.getResponse(HttpURLConnection) Redundant null check at WebHdfsFileSystem.java: [line 897] Subsystem Report/Notes Docker Image:yetus/hadoop:a9ad5d6 JIRA Issue HDFS-11280 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845110/HDFS-11280.for.2.8.and.beyond.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 93fa081b4102 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 95c2c24 Default Java 1.8.0_111 findbugs v3.0.0 findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/17988/artifact/patchprocess/new-findbugs-hadoop-hdfs-project_hadoop-hdfs-client.html Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/17988/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs-client U: hadoop-hdfs-project/hadoop-hdfs-client Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17988/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        zshao Zheng Shao added a comment -

        Addressed findbug issue - getInputStream() is known to return non-null, so earlier null check is redundant.

        Show
        zshao Zheng Shao added a comment - Addressed findbug issue - getInputStream() is known to return non-null, so earlier null check is redundant.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 17s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 mvninstall 13m 23s trunk passed
        +1 compile 0m 30s trunk passed
        +1 checkstyle 0m 16s trunk passed
        +1 mvnsite 0m 35s trunk passed
        +1 mvneclipse 0m 14s trunk passed
        +1 findbugs 1m 39s trunk passed
        +1 javadoc 0m 23s trunk passed
        +1 mvninstall 0m 33s the patch passed
        +1 compile 0m 32s the patch passed
        +1 javac 0m 32s the patch passed
        +1 checkstyle 0m 12s the patch passed
        +1 mvnsite 0m 33s the patch passed
        +1 mvneclipse 0m 11s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 40s the patch passed
        +1 javadoc 0m 19s the patch passed
        +1 unit 0m 55s hadoop-hdfs-client in the patch passed.
        +1 asflicense 0m 17s The patch does not generate ASF License warnings.
        23m 46s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:a9ad5d6
        JIRA Issue HDFS-11280
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845200/HDFS-11280.for.2.8.and.beyond.2.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 04a7e803a1f5 3.13.0-105-generic #152-Ubuntu SMP Fri Dec 2 15:37:11 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 165d01a
        Default Java 1.8.0_111
        findbugs v3.0.0
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/17993/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs-client U: hadoop-hdfs-project/hadoop-hdfs-client
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17993/console
        Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 13m 23s trunk passed +1 compile 0m 30s trunk passed +1 checkstyle 0m 16s trunk passed +1 mvnsite 0m 35s trunk passed +1 mvneclipse 0m 14s trunk passed +1 findbugs 1m 39s trunk passed +1 javadoc 0m 23s trunk passed +1 mvninstall 0m 33s the patch passed +1 compile 0m 32s the patch passed +1 javac 0m 32s the patch passed +1 checkstyle 0m 12s the patch passed +1 mvnsite 0m 33s the patch passed +1 mvneclipse 0m 11s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 40s the patch passed +1 javadoc 0m 19s the patch passed +1 unit 0m 55s hadoop-hdfs-client in the patch passed. +1 asflicense 0m 17s The patch does not generate ASF License warnings. 23m 46s Subsystem Report/Notes Docker Image:yetus/hadoop:a9ad5d6 JIRA Issue HDFS-11280 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845200/HDFS-11280.for.2.8.and.beyond.2.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 04a7e803a1f5 3.13.0-105-generic #152-Ubuntu SMP Fri Dec 2 15:37:11 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 165d01a Default Java 1.8.0_111 findbugs v3.0.0 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/17993/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs-client U: hadoop-hdfs-project/hadoop-hdfs-client Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17993/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        zshao Zheng Shao added a comment -

        > The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.

        In order to verify the HTTP Keep Alive is enabled, we need to look at network stats at system level (using netstat for example) and that is platform-dependent. It's not a good test to mock the underlying UrlConnection using factory because the contract to the tested (getInputStrea().close() trigger HTTP Keep-Alive is in JDK's HttpUrlConnection class, and mocking it out defeats the purpose of testing).

        Manual steps used to verify the bug fix is listed in the description.

        Show
        zshao Zheng Shao added a comment - > The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. In order to verify the HTTP Keep Alive is enabled, we need to look at network stats at system level (using netstat for example) and that is platform-dependent. It's not a good test to mock the underlying UrlConnection using factory because the contract to the tested (getInputStrea().close() trigger HTTP Keep-Alive is in JDK's HttpUrlConnection class, and mocking it out defeats the purpose of testing). Manual steps used to verify the bug fix is listed in the description.
        Hide
        wheat9 Haohui Mai added a comment -

        The patch looks good to me overall. It might be worthwhile to fix the other caller of the disconnect() method as well:

                try {
                  validateResponse(redirectOp, conn, false);
                  url = new URL(conn.getHeaderField("Location"));
                  redirectHost = url.getHost() + ":" + url.getPort();
                } finally {
                  conn.disconnect();
                }
        

        +1 once it is addressed.

        Show
        wheat9 Haohui Mai added a comment - The patch looks good to me overall. It might be worthwhile to fix the other caller of the disconnect() method as well: try { validateResponse(redirectOp, conn, false); url = new URL(conn.getHeaderField("Location")); redirectHost = url.getHost() + ":" + url.getPort(); } finally { conn.disconnect(); } +1 once it is addressed.
        Hide
        zshao Zheng Shao added a comment -

        Replaced the other instance of conn.disconnect().

        Also added comment for why the 3rd instance doesn't need to be replaced.

        Show
        zshao Zheng Shao added a comment - Replaced the other instance of conn.disconnect(). Also added comment for why the 3rd instance doesn't need to be replaced.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 15s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 mvninstall 14m 31s trunk passed
        +1 compile 0m 33s trunk passed
        +1 checkstyle 0m 17s trunk passed
        +1 mvnsite 0m 38s trunk passed
        +1 mvneclipse 0m 12s trunk passed
        +1 findbugs 1m 39s trunk passed
        +1 javadoc 0m 24s trunk passed
        +1 mvninstall 0m 33s the patch passed
        +1 compile 0m 30s the patch passed
        +1 javac 0m 30s the patch passed
        +1 checkstyle 0m 14s the patch passed
        +1 mvnsite 0m 33s the patch passed
        +1 mvneclipse 0m 11s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 49s the patch passed
        +1 javadoc 0m 21s the patch passed
        +1 unit 1m 1s hadoop-hdfs-client in the patch passed.
        +1 asflicense 0m 18s The patch does not generate ASF License warnings.
        25m 28s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:a9ad5d6
        JIRA Issue HDFS-11280
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845207/HDFS-11280.for.2.8.and.beyond.4.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux c5a98e37f4c2 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 165d01a
        Default Java 1.8.0_111
        findbugs v3.0.0
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/17994/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs-client U: hadoop-hdfs-project/hadoop-hdfs-client
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17994/console
        Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 15s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 14m 31s trunk passed +1 compile 0m 33s trunk passed +1 checkstyle 0m 17s trunk passed +1 mvnsite 0m 38s trunk passed +1 mvneclipse 0m 12s trunk passed +1 findbugs 1m 39s trunk passed +1 javadoc 0m 24s trunk passed +1 mvninstall 0m 33s the patch passed +1 compile 0m 30s the patch passed +1 javac 0m 30s the patch passed +1 checkstyle 0m 14s the patch passed +1 mvnsite 0m 33s the patch passed +1 mvneclipse 0m 11s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 49s the patch passed +1 javadoc 0m 21s the patch passed +1 unit 1m 1s hadoop-hdfs-client in the patch passed. +1 asflicense 0m 18s The patch does not generate ASF License warnings. 25m 28s Subsystem Report/Notes Docker Image:yetus/hadoop:a9ad5d6 JIRA Issue HDFS-11280 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845207/HDFS-11280.for.2.8.and.beyond.4.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux c5a98e37f4c2 3.13.0-95-generic #142-Ubuntu SMP Fri Aug 12 17:00:09 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 165d01a Default Java 1.8.0_111 findbugs v3.0.0 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/17994/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs-client U: hadoop-hdfs-project/hadoop-hdfs-client Console output https://builds.apache.org/job/PreCommit-HDFS-Build/17994/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        wheat9 Haohui Mai added a comment -

        +1. Will commit shortly.

        Show
        wheat9 Haohui Mai added a comment - +1. Will commit shortly.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11060 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11060/)
        HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed (wheat9: rev b811a1c14d00ab236158ab75fad1fe41364045a4)

        • (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11060 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11060/ ) HDFS-11280 . Allow WebHDFS to reuse HTTP connections to NN. Contributed (wheat9: rev b811a1c14d00ab236158ab75fad1fe41364045a4) (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
        Hide
        wheat9 Haohui Mai added a comment -

        Commit to trunk, branch-2, branch-2.8 and branch-2.7. Thanks Zheng Shao for the contributions.

        Show
        wheat9 Haohui Mai added a comment - Commit to trunk, branch-2, branch-2.8 and branch-2.7. Thanks Zheng Shao for the contributions.
        Hide
        brahmareddy Brahma Reddy Battula added a comment -

        There are so many testcases are failing after this commit..Following is the stacktrace. will you look into this..?

        java.io.IOException: localhost:52693: Server returned HTTP response code: 403 for URL: http://localhost:52693/webhdfs/v1/srcdat/three/1925354346738733427?op=OPEN&user.name=bob&buffersize=4096&offset=0
        	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1926)
        	at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1921)
        	at java.security.AccessController.doPrivileged(Native Method)
        	at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1920)
        	at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1490)
        	at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474)
        	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.connect(WebHdfsFileSystem.java:664)
        	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$ReadRunner.connect(WebHdfsFileSystem.java:1997)
        	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.runWithRetry(WebHdfsFileSystem.java:740)
        	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.access$100(WebHdfsFileSystem.java:584)
        	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner$1.run(WebHdfsFileSystem.java:615)
        	at java.security.AccessController.doPrivileged(Native Method)
        	at javax.security.auth.Subject.doAs(Subject.java:422)
        	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1857)
        	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.run(WebHdfsFileSystem.java:611)
        	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$ReadRunner.read(WebHdfsFileSystem.java:1946)
        	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream.read(WebHdfsFileSystem.java:1804)
        	at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream.read(WebHdfsFileSystem.java:1799)
        	at java.io.FilterInputStream.read(FilterInputStream.java:83)
        	at org.apache.hadoop.hdfs.server.namenode.TestAuditLogs.testAuditWebHdfsDenied(TestAuditLogs.java:249)
        

        FYR
        https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/273/testReport/junit/

        Show
        brahmareddy Brahma Reddy Battula added a comment - There are so many testcases are failing after this commit..Following is the stacktrace. will you look into this..? java.io.IOException: localhost:52693: Server returned HTTP response code: 403 for URL: http://localhost:52693/webhdfs/v1/srcdat/three/1925354346738733427?op=OPEN&user.name=bob&buffersize=4096&offset=0 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1926) at sun.net.www.protocol.http.HttpURLConnection$10.run(HttpURLConnection.java:1921) at java.security.AccessController.doPrivileged(Native Method) at sun.net.www.protocol.http.HttpURLConnection.getChainedException(HttpURLConnection.java:1920) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1490) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1474) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.connect(WebHdfsFileSystem.java:664) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$ReadRunner.connect(WebHdfsFileSystem.java:1997) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.runWithRetry(WebHdfsFileSystem.java:740) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.access$100(WebHdfsFileSystem.java:584) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner$1.run(WebHdfsFileSystem.java:615) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1857) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$AbstractRunner.run(WebHdfsFileSystem.java:611) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$ReadRunner.read(WebHdfsFileSystem.java:1946) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream.read(WebHdfsFileSystem.java:1804) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$WebHdfsInputStream.read(WebHdfsFileSystem.java:1799) at java.io.FilterInputStream.read(FilterInputStream.java:83) at org.apache.hadoop.hdfs.server.namenode.TestAuditLogs.testAuditWebHdfsDenied(TestAuditLogs.java:249) FYR https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/273/testReport/junit/
        Hide
        jzhuge John Zhuge added a comment -

        These unit test failures may be caused by this patch: TestWebHDFSXAttr, TestWebHDFS, TestWebHdfsTokens, TestWebHdfsWithRestCsrfPreventionFilter, and TestAuditLogs. After reverting the trunk to "165d01a YARN-5931. Document timeout interfaces CLI and REST APIs (Contributed by Rohith Sharma K S via Daniel Templeton)", these unit tests all passed.

        https://builds.apache.org/job/PreCommit-HADOOP-Build/11338/artifact/patchprocess/patch-unit-root.txt

        Show
        jzhuge John Zhuge added a comment - These unit test failures may be caused by this patch: TestWebHDFSXAttr, TestWebHDFS, TestWebHdfsTokens, TestWebHdfsWithRestCsrfPreventionFilter, and TestAuditLogs. After reverting the trunk to "165d01a YARN-5931 . Document timeout interfaces CLI and REST APIs (Contributed by Rohith Sharma K S via Daniel Templeton)", these unit tests all passed. https://builds.apache.org/job/PreCommit-HADOOP-Build/11338/artifact/patchprocess/patch-unit-root.txt
        Hide
        cheersyang Weiwei Yang added a comment -

        Hi John Zhuge

        I did not try all failed tests, but at least this patch is breaking TestWebHDFS#testCreateWithNoDN, I could get this test pass if I revert the changes this patch has made. Please check.

        Show
        cheersyang Weiwei Yang added a comment - Hi John Zhuge I did not try all failed tests, but at least this patch is breaking TestWebHDFS#testCreateWithNoDN , I could get this test pass if I revert the changes this patch has made. Please check.
        Hide
        jzhuge John Zhuge added a comment -

        Same here Weiwei Yang.

        Show
        jzhuge John Zhuge added a comment - Same here Weiwei Yang .
        Hide
        zshao Zheng Shao added a comment -

        Sorry guys, I think we need to revert this patch. My initial understanding is that the HTTP Keep-Alive is breaking some assumptions in the WebHDFS code.

        Haohui Mai can you help revert this?

        I will take a second look at the breaking Tests.

        Show
        zshao Zheng Shao added a comment - Sorry guys, I think we need to revert this patch. My initial understanding is that the HTTP Keep-Alive is breaking some assumptions in the WebHDFS code. Haohui Mai can you help revert this? I will take a second look at the breaking Tests.
        Hide
        brahmareddy Brahma Reddy Battula added a comment -

        Zheng Shao thanks for your reply and confirmation..

        I will revert this patch today..

        Show
        brahmareddy Brahma Reddy Battula added a comment - Zheng Shao thanks for your reply and confirmation.. I will revert this patch today..
        Hide
        brahmareddy Brahma Reddy Battula added a comment -

        Reverted as it's broken the testcases.

        Show
        brahmareddy Brahma Reddy Battula added a comment - Reverted as it's broken the testcases.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11062 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11062/)
        Revert "HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. (brahma: rev b31e1951e044b2c6f6e88a007a8c175941ddd674)

        • (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11062 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11062/ ) Revert " HDFS-11280 . Allow WebHDFS to reuse HTTP connections to NN. (brahma: rev b31e1951e044b2c6f6e88a007a8c175941ddd674) (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
        Hide
        wheat9 Haohui Mai added a comment -

        Any ideas why Jenkins is still happy?

        Show
        wheat9 Haohui Mai added a comment - Any ideas why Jenkins is still happy?
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 0s Docker mode activated.
        -1 patch 0m 5s HDFS-11280 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help.



        Subsystem Report/Notes
        JIRA Issue HDFS-11280
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845434/HDFS-11280.for.2.7.and.below.patch
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/18009/console
        Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 0s Docker mode activated. -1 patch 0m 5s HDFS-11280 does not apply to trunk. Rebase required? Wrong Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. Subsystem Report/Notes JIRA Issue HDFS-11280 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845434/HDFS-11280.for.2.7.and.below.patch Console output https://builds.apache.org/job/PreCommit-HDFS-Build/18009/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        zshao Zheng Shao added a comment -

        The Test Failures were caused by the calling of "conn.getInputStream()" in the case of HTTP Redirect. Since HTTP Redirect will be slow and won't cause the ephemeral port problem, I will skip that change for now.

        I've uploaded a new patch that passes all the earlier failed tests.

        Show
        zshao Zheng Shao added a comment - The Test Failures were caused by the calling of "conn.getInputStream()" in the case of HTTP Redirect. Since HTTP Redirect will be slow and won't cause the ephemeral port problem, I will skip that change for now. I've uploaded a new patch that passes all the earlier failed tests.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 13s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 mvninstall 14m 48s trunk passed
        +1 compile 0m 38s trunk passed
        +1 checkstyle 0m 16s trunk passed
        +1 mvnsite 0m 39s trunk passed
        +1 mvneclipse 0m 13s trunk passed
        +1 findbugs 1m 33s trunk passed
        +1 javadoc 0m 25s trunk passed
        +1 mvninstall 0m 39s the patch passed
        +1 compile 0m 31s the patch passed
        +1 javac 0m 31s the patch passed
        -0 checkstyle 0m 14s hadoop-hdfs-project/hadoop-hdfs-client: The patch generated 1 new + 62 unchanged - 0 fixed = 63 total (was 62)
        +1 mvnsite 0m 32s the patch passed
        +1 mvneclipse 0m 10s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 39s the patch passed
        +1 javadoc 0m 19s the patch passed
        +1 unit 1m 3s hadoop-hdfs-client in the patch passed.
        +1 asflicense 0m 18s The patch does not generate ASF License warnings.
        25m 29s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:a9ad5d6
        JIRA Issue HDFS-11280
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845438/HDFS-11280.for.2.8.and.beyond.5.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux aba63058763e 3.13.0-105-generic #152-Ubuntu SMP Fri Dec 2 15:37:11 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / ebdd2e0
        Default Java 1.8.0_111
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/18011/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs-client.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/18011/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs-client U: hadoop-hdfs-project/hadoop-hdfs-client
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/18011/console
        Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 13s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 14m 48s trunk passed +1 compile 0m 38s trunk passed +1 checkstyle 0m 16s trunk passed +1 mvnsite 0m 39s trunk passed +1 mvneclipse 0m 13s trunk passed +1 findbugs 1m 33s trunk passed +1 javadoc 0m 25s trunk passed +1 mvninstall 0m 39s the patch passed +1 compile 0m 31s the patch passed +1 javac 0m 31s the patch passed -0 checkstyle 0m 14s hadoop-hdfs-project/hadoop-hdfs-client: The patch generated 1 new + 62 unchanged - 0 fixed = 63 total (was 62) +1 mvnsite 0m 32s the patch passed +1 mvneclipse 0m 10s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 39s the patch passed +1 javadoc 0m 19s the patch passed +1 unit 1m 3s hadoop-hdfs-client in the patch passed. +1 asflicense 0m 18s The patch does not generate ASF License warnings. 25m 29s Subsystem Report/Notes Docker Image:yetus/hadoop:a9ad5d6 JIRA Issue HDFS-11280 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12845438/HDFS-11280.for.2.8.and.beyond.5.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux aba63058763e 3.13.0-105-generic #152-Ubuntu SMP Fri Dec 2 15:37:11 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / ebdd2e0 Default Java 1.8.0_111 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/18011/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs-client.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/18011/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs-client U: hadoop-hdfs-project/hadoop-hdfs-client Console output https://builds.apache.org/job/PreCommit-HDFS-Build/18011/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        hanishakoneru Hanisha Koneru added a comment -

        Verified that the following unit tests are passing now.

        • TestWebHDFSXAttr
        • TestWebHDFS
        • TestWebHdfsTokens
        • TestWebHdfsWithRestCsrfPreventionFilter
        • TestAuditLogs
        Show
        hanishakoneru Hanisha Koneru added a comment - Verified that the following unit tests are passing now. TestWebHDFSXAttr TestWebHDFS TestWebHdfsTokens TestWebHdfsWithRestCsrfPreventionFilter TestAuditLogs
        Hide
        brahmareddy Brahma Reddy Battula added a comment -

        As changes are only in hdfs-client ,Tests did not run on hadoop-hdfs project.hence jenkins did not catch here..

        Actually I suggested earlier,atleast we should run parent project( cd to parent project) testcases..but it did not happen..

        unit test pre-reqs:
        cd /testptch/hadoop/hadoop-common-project/hadoop-common
        mvn -Dmaven.repo.local=/home/jenkins/yetus-m2/hadoop-trunk-patch-0 install -DskipTests -Pnative -Drequire.libwebhdfs -Drequire.snappy -Drequire.openssl -Drequire.fuse -Drequire.test.libhadoop -Pyarn-ui > /testptch/hadoop/patchprocess/maven-unit-prereq-hadoop-common-project_hadoop-common-install.txt 2>&1
        cd /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs-client
        mvn -Dmaven.repo.local=/home/jenkins/yetus-m2/hadoop-trunk-patch-0 -Ptest-patch -Pparallel-tests -P!shelltest -Pnative -Drequire.libwebhdfs -Drequire.snappy -Drequire.openssl -Drequire.fuse -Drequire.test.libhadoop -Pyarn-ui clean test -fae > /testptch/hadoop/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-client.txt 2>&1
        Elapsed:   1m  1s
        
        hadoop-hdfs-client in the patch passed.
        
        Show
        brahmareddy Brahma Reddy Battula added a comment - As changes are only in hdfs-client ,Tests did not run on hadoop-hdfs project.hence jenkins did not catch here.. Actually I suggested earlier,atleast we should run parent project( cd to parent project) testcases..but it did not happen.. unit test pre-reqs: cd /testptch/hadoop/hadoop-common-project/hadoop-common mvn -Dmaven.repo.local=/home/jenkins/yetus-m2/hadoop-trunk-patch-0 install -DskipTests -Pnative -Drequire.libwebhdfs -Drequire.snappy -Drequire.openssl -Drequire.fuse -Drequire.test.libhadoop -Pyarn-ui > /testptch/hadoop/patchprocess/maven-unit-prereq-hadoop-common-project_hadoop-common-install.txt 2>&1 cd /testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs-client mvn -Dmaven.repo.local=/home/jenkins/yetus-m2/hadoop-trunk-patch-0 -Ptest-patch -Pparallel-tests -P!shelltest -Pnative -Drequire.libwebhdfs -Drequire.snappy -Drequire.openssl -Drequire.fuse -Drequire.test.libhadoop -Pyarn-ui clean test -fae > /testptch/hadoop/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-client.txt 2>&1 Elapsed: 1m 1s hadoop-hdfs-client in the patch passed.
        Hide
        wheat9 Haohui Mai added a comment -

        Validate that the the latest patch passes the unit tests mentioned in the jira. Committing.

        Show
        wheat9 Haohui Mai added a comment - Validate that the the latest patch passes the unit tests mentioned in the jira. Committing.
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11074 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11074/)
        HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed (wheat9: rev a605ff36a53a3d1283c3f6d81eb073e4a2942143)

        • (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11074 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11074/ ) HDFS-11280 . Allow WebHDFS to reuse HTTP connections to NN. Contributed (wheat9: rev a605ff36a53a3d1283c3f6d81eb073e4a2942143) (edit) hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java
        Hide
        wheat9 Haohui Mai added a comment -

        Committed all the way down to branch-2.7. Many thanks everyone for reporting and validating the issues.

        Show
        wheat9 Haohui Mai added a comment - Committed all the way down to branch-2.7. Many thanks everyone for reporting and validating the issues.

          People

          • Assignee:
            zshao Zheng Shao
            Reporter:
            zshao Zheng Shao
          • Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development