Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14383

Implement FileSystem that reads from HTTP / HTTPS endpoints

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha4
    • Component/s: fs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      We have a use case where YARN applications would like to localize resources from Artifactory. Putting the resources on HDFS itself might not be ideal as we would like to leverage Artifactory to manage different versions of the resources.

      It would be nice to have something like HttpFileSystem that implements the Hadoop filesystem API and reads from a HTTP endpoint.

      Note that Samza has implemented the proposal by themselves:

      https://github.com/apache/samza/blob/master/samza-yarn/src/main/scala/org/apache/samza/util/hadoop/HttpFileSystem.scala

      The downside of this approach is that it requires the YARN cluster to put the Samza jar into the classpath for each NM.

      It would be much nicer for Hadoop to have this feature built-in.

      1. HADOOP-14383.000.patch
        12 kB
        Haohui Mai
      2. HADOOP-14383.001.patch
        13 kB
        Haohui Mai
      3. HADOOP-14383.002.patch
        14 kB
        Haohui Mai

        Issue Links

          Activity

          Hide
          jzhuge John Zhuge added a comment -

          Is it possible to pick different schemes than http: and https? Reusing such well known schemes seem risky.

          Show
          jzhuge John Zhuge added a comment - Is it possible to pick different schemes than http: and https ? Reusing such well known schemes seem risky.
          Hide
          stevel@apache.org Steve Loughran added a comment -

          This breaks WASB clients on spark, see HADOOP-14598. We should not be returning our FS connections when the normal https/http, schemas come in, because they aren't done properly.

          Can we do one of: revert, disable registration, fix?

          Show
          stevel@apache.org Steve Loughran added a comment - This breaks WASB clients on spark, see HADOOP-14598 . We should not be returning our FS connections when the normal https/http, schemas come in, because they aren't done properly. Can we do one of: revert, disable registration, fix?
          Hide
          vagarychen Chen Liang added a comment -

          hi Haohui Mai,

          I have got a question when reading the patch. In TestHttpFileSystem#testHttpFileSystem, there is

          conf.set("fs.http.impl", HttpFileSystem.class.getCanonicalName());
          

          Is this necessary? Because I did not find the key fs.http.impl used anywhere else. Plus, the test still passed after I commented this line. If this is not necessary, do you mind if I file a JIRA to remove this?

          Show
          vagarychen Chen Liang added a comment - hi Haohui Mai , I have got a question when reading the patch. In TestHttpFileSystem#testHttpFileSystem , there is conf.set( "fs.http.impl" , HttpFileSystem.class.getCanonicalName()); Is this necessary? Because I did not find the key fs.http.impl used anywhere else. Plus, the test still passed after I commented this line. If this is not necessary, do you mind if I file a JIRA to remove this?
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11698 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11698/)
          HADOOP-14383. Implement FileSystem that reads from HTTP / HTTPS (wheat9: rev ff5ec3b841612f7f28ad8be5bbfec4168a8ac1f0)

          • (add) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/http/package-info.java
          • (edit) hadoop-common-project/hadoop-common/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem
          • (edit) hadoop-project/pom.xml
          • (edit) hadoop-common-project/hadoop-common/pom.xml
          • (add) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java
          • (add) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/http/AbstractHttpFileSystem.java
          • (add) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/http/HttpsFileSystem.java
          • (add) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/http/HttpFileSystem.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11698 (See https://builds.apache.org/job/Hadoop-trunk-Commit/11698/ ) HADOOP-14383 . Implement FileSystem that reads from HTTP / HTTPS (wheat9: rev ff5ec3b841612f7f28ad8be5bbfec4168a8ac1f0) (add) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/http/package-info.java (edit) hadoop-common-project/hadoop-common/src/main/resources/META-INF/services/org.apache.hadoop.fs.FileSystem (edit) hadoop-project/pom.xml (edit) hadoop-common-project/hadoop-common/pom.xml (add) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/http/TestHttpFileSystem.java (add) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/http/AbstractHttpFileSystem.java (add) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/http/HttpsFileSystem.java (add) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/http/HttpFileSystem.java
          Hide
          liuml07 Mingliang Liu added a comment -

          Nice work. Updated the components and "Fix Versions".

          Show
          liuml07 Mingliang Liu added a comment - Nice work. Updated the components and "Fix Versions".
          Hide
          wheat9 Haohui Mai added a comment -

          Committed to trunk and branch-2. Thanks Li Lu for the reviews!

          Show
          wheat9 Haohui Mai added a comment - Committed to trunk and branch-2. Thanks Li Lu for the reviews!
          Hide
          wheat9 Haohui Mai added a comment -

          The findbugs warnings are unrelated. Merging.

          Show
          wheat9 Haohui Mai added a comment - The findbugs warnings are unrelated. Merging.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 21s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          0 mvndep 0m 15s Maven dependency ordering for branch
          +1 mvninstall 15m 14s trunk passed
          +1 compile 16m 12s trunk passed
          +1 checkstyle 1m 56s trunk passed
          +1 mvnsite 1m 28s trunk passed
          +1 mvneclipse 0m 40s trunk passed
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project
          -1 findbugs 1m 25s hadoop-common-project/hadoop-common in trunk has 19 extant Findbugs warnings.
          +1 javadoc 1m 10s trunk passed
          0 mvndep 0m 15s Maven dependency ordering for patch
          +1 mvninstall 1m 0s the patch passed
          +1 compile 15m 52s the patch passed
          +1 javac 15m 52s the patch passed
          +1 checkstyle 1m 57s the patch passed
          +1 mvnsite 1m 28s the patch passed
          +1 mvneclipse 0m 46s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 xml 0m 3s The patch has no ill-formed XML file.
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project
          +1 findbugs 1m 46s the patch passed
          +1 javadoc 1m 22s the patch passed
          +1 unit 0m 19s hadoop-project in the patch passed.
          +1 unit 8m 53s hadoop-common in the patch passed.
          +1 asflicense 0m 40s The patch does not generate ASF License warnings.
          97m 18s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue HADOOP-14383
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12866743/HADOOP-14383.002.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml findbugs checkstyle
          uname Linux 8654d4a8ebdd 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / d6eed5a
          Default Java 1.8.0_131
          findbugs v3.1.0-RC1
          findbugs https://builds.apache.org/job/PreCommit-HADOOP-Build/12258/artifact/patchprocess/branch-findbugs-hadoop-common-project_hadoop-common-warnings.html
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12258/testReport/
          modules C: hadoop-project hadoop-common-project/hadoop-common U: .
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12258/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 21s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 0m 15s Maven dependency ordering for branch +1 mvninstall 15m 14s trunk passed +1 compile 16m 12s trunk passed +1 checkstyle 1m 56s trunk passed +1 mvnsite 1m 28s trunk passed +1 mvneclipse 0m 40s trunk passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project -1 findbugs 1m 25s hadoop-common-project/hadoop-common in trunk has 19 extant Findbugs warnings. +1 javadoc 1m 10s trunk passed 0 mvndep 0m 15s Maven dependency ordering for patch +1 mvninstall 1m 0s the patch passed +1 compile 15m 52s the patch passed +1 javac 15m 52s the patch passed +1 checkstyle 1m 57s the patch passed +1 mvnsite 1m 28s the patch passed +1 mvneclipse 0m 46s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 3s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project +1 findbugs 1m 46s the patch passed +1 javadoc 1m 22s the patch passed +1 unit 0m 19s hadoop-project in the patch passed. +1 unit 8m 53s hadoop-common in the patch passed. +1 asflicense 0m 40s The patch does not generate ASF License warnings. 97m 18s Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue HADOOP-14383 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12866743/HADOOP-14383.002.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml findbugs checkstyle uname Linux 8654d4a8ebdd 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / d6eed5a Default Java 1.8.0_131 findbugs v3.1.0-RC1 findbugs https://builds.apache.org/job/PreCommit-HADOOP-Build/12258/artifact/patchprocess/branch-findbugs-hadoop-common-project_hadoop-common-warnings.html Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12258/testReport/ modules C: hadoop-project hadoop-common-project/hadoop-common U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12258/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 16s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          0 mvndep 1m 24s Maven dependency ordering for branch
          +1 mvninstall 13m 24s trunk passed
          +1 compile 15m 19s trunk passed
          +1 checkstyle 1m 52s trunk passed
          +1 mvnsite 1m 28s trunk passed
          +1 mvneclipse 0m 38s trunk passed
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project
          -1 findbugs 1m 23s hadoop-common-project/hadoop-common in trunk has 19 extant Findbugs warnings.
          +1 javadoc 1m 12s trunk passed
          0 mvndep 0m 20s Maven dependency ordering for patch
          +1 mvninstall 0m 51s the patch passed
          +1 compile 13m 4s the patch passed
          +1 javac 13m 4s the patch passed
          -0 checkstyle 1m 57s root: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
          +1 mvnsite 1m 26s the patch passed
          +1 mvneclipse 0m 44s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 xml 0m 2s The patch has no ill-formed XML file.
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project
          +1 findbugs 1m 33s the patch passed
          +1 javadoc 1m 17s the patch passed
          +1 unit 0m 21s hadoop-project in the patch passed.
          -1 unit 7m 36s hadoop-common in the patch failed.
          +1 asflicense 0m 40s The patch does not generate ASF License warnings.
          91m 13s



          Reason Tests
          Failed junit tests hadoop.fs.sftp.TestSFTPFileSystem



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue HADOOP-14383
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12866723/HADOOP-14383.001.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml findbugs checkstyle
          uname Linux ce3f63450565 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / d6eed5a
          Default Java 1.8.0_131
          findbugs v3.1.0-RC1
          findbugs https://builds.apache.org/job/PreCommit-HADOOP-Build/12256/artifact/patchprocess/branch-findbugs-hadoop-common-project_hadoop-common-warnings.html
          checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/12256/artifact/patchprocess/diff-checkstyle-root.txt
          unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12256/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12256/testReport/
          modules C: hadoop-project hadoop-common-project/hadoop-common U: .
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12256/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 16s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 1m 24s Maven dependency ordering for branch +1 mvninstall 13m 24s trunk passed +1 compile 15m 19s trunk passed +1 checkstyle 1m 52s trunk passed +1 mvnsite 1m 28s trunk passed +1 mvneclipse 0m 38s trunk passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project -1 findbugs 1m 23s hadoop-common-project/hadoop-common in trunk has 19 extant Findbugs warnings. +1 javadoc 1m 12s trunk passed 0 mvndep 0m 20s Maven dependency ordering for patch +1 mvninstall 0m 51s the patch passed +1 compile 13m 4s the patch passed +1 javac 13m 4s the patch passed -0 checkstyle 1m 57s root: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0) +1 mvnsite 1m 26s the patch passed +1 mvneclipse 0m 44s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 2s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project +1 findbugs 1m 33s the patch passed +1 javadoc 1m 17s the patch passed +1 unit 0m 21s hadoop-project in the patch passed. -1 unit 7m 36s hadoop-common in the patch failed. +1 asflicense 0m 40s The patch does not generate ASF License warnings. 91m 13s Reason Tests Failed junit tests hadoop.fs.sftp.TestSFTPFileSystem Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue HADOOP-14383 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12866723/HADOOP-14383.001.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml findbugs checkstyle uname Linux ce3f63450565 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / d6eed5a Default Java 1.8.0_131 findbugs v3.1.0-RC1 findbugs https://builds.apache.org/job/PreCommit-HADOOP-Build/12256/artifact/patchprocess/branch-findbugs-hadoop-common-project_hadoop-common-warnings.html checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/12256/artifact/patchprocess/diff-checkstyle-root.txt unit https://builds.apache.org/job/PreCommit-HADOOP-Build/12256/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12256/testReport/ modules C: hadoop-project hadoop-common-project/hadoop-common U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12256/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          gtCarrera9 Li Lu added a comment -

          Thanks for the work Haohui Mai! This is useful. The previous Jenkins run reveals several findbugs warnings but they appear to be existing ones in our codebase. +1 pending Jenkins.

          Show
          gtCarrera9 Li Lu added a comment - Thanks for the work Haohui Mai ! This is useful. The previous Jenkins run reveals several findbugs warnings but they appear to be existing ones in our codebase. +1 pending Jenkins.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 23s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
          0 mvndep 1m 25s Maven dependency ordering for branch
          +1 mvninstall 14m 44s trunk passed
          +1 compile 17m 53s trunk passed
          +1 checkstyle 2m 0s trunk passed
          +1 mvnsite 1m 27s trunk passed
          +1 mvneclipse 0m 38s trunk passed
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project
          -1 findbugs 1m 30s hadoop-common-project/hadoop-common in trunk has 19 extant Findbugs warnings.
          +1 javadoc 1m 10s trunk passed
          0 mvndep 0m 19s Maven dependency ordering for patch
          +1 mvninstall 0m 52s the patch passed
          +1 compile 15m 26s the patch passed
          +1 javac 15m 26s the patch passed
          -0 checkstyle 2m 3s root: The patch generated 14 new + 0 unchanged - 0 fixed = 14 total (was 0)
          +1 mvnsite 1m 27s the patch passed
          +1 mvneclipse 0m 40s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 xml 0m 3s The patch has no ill-formed XML file.
          0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project
          +1 findbugs 1m 52s the patch passed
          +1 javadoc 1m 15s the patch passed
          +1 unit 0m 21s hadoop-project in the patch passed.
          +1 unit 7m 50s hadoop-common in the patch passed.
          +1 asflicense 0m 41s The patch does not generate ASF License warnings.
          97m 44s



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:14b5c93
          JIRA Issue HADOOP-14383
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12866522/HADOOP-14383.000.patch
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml findbugs checkstyle
          uname Linux 7d49564d0c50 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 3082552
          Default Java 1.8.0_121
          findbugs v3.1.0-RC1
          findbugs https://builds.apache.org/job/PreCommit-HADOOP-Build/12242/artifact/patchprocess/branch-findbugs-hadoop-common-project_hadoop-common-warnings.html
          checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/12242/artifact/patchprocess/diff-checkstyle-root.txt
          Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12242/testReport/
          modules C: hadoop-project hadoop-common-project/hadoop-common U: .
          Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12242/console
          Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 23s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. 0 mvndep 1m 25s Maven dependency ordering for branch +1 mvninstall 14m 44s trunk passed +1 compile 17m 53s trunk passed +1 checkstyle 2m 0s trunk passed +1 mvnsite 1m 27s trunk passed +1 mvneclipse 0m 38s trunk passed 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project -1 findbugs 1m 30s hadoop-common-project/hadoop-common in trunk has 19 extant Findbugs warnings. +1 javadoc 1m 10s trunk passed 0 mvndep 0m 19s Maven dependency ordering for patch +1 mvninstall 0m 52s the patch passed +1 compile 15m 26s the patch passed +1 javac 15m 26s the patch passed -0 checkstyle 2m 3s root: The patch generated 14 new + 0 unchanged - 0 fixed = 14 total (was 0) +1 mvnsite 1m 27s the patch passed +1 mvneclipse 0m 40s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 3s The patch has no ill-formed XML file. 0 findbugs 0m 0s Skipped patched modules with no Java source: hadoop-project +1 findbugs 1m 52s the patch passed +1 javadoc 1m 15s the patch passed +1 unit 0m 21s hadoop-project in the patch passed. +1 unit 7m 50s hadoop-common in the patch passed. +1 asflicense 0m 41s The patch does not generate ASF License warnings. 97m 44s Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue HADOOP-14383 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12866522/HADOOP-14383.000.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit xml findbugs checkstyle uname Linux 7d49564d0c50 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6 15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 3082552 Default Java 1.8.0_121 findbugs v3.1.0-RC1 findbugs https://builds.apache.org/job/PreCommit-HADOOP-Build/12242/artifact/patchprocess/branch-findbugs-hadoop-common-project_hadoop-common-warnings.html checkstyle https://builds.apache.org/job/PreCommit-HADOOP-Build/12242/artifact/patchprocess/diff-checkstyle-root.txt Test Results https://builds.apache.org/job/PreCommit-HADOOP-Build/12242/testReport/ modules C: hadoop-project hadoop-common-project/hadoop-common U: . Console output https://builds.apache.org/job/PreCommit-HADOOP-Build/12242/console Powered by Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          wheat9 Haohui Mai added a comment -

          Correct. Moving it under hadoop common.

          Show
          wheat9 Haohui Mai added a comment - Correct. Moving it under hadoop common.
          Hide
          jlowe Jason Lowe added a comment -

          Wouldn't the new HTTP filesystem appear in the Hadoop Common project rather than YARN? I don't see why it would need to be something specific to YARN.

          Show
          jlowe Jason Lowe added a comment - Wouldn't the new HTTP filesystem appear in the Hadoop Common project rather than YARN? I don't see why it would need to be something specific to YARN.

            People

            • Assignee:
              wheat9 Haohui Mai
              Reporter:
              wheat9 Haohui Mai
            • Votes:
              0 Vote for this issue
              Watchers:
              17 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development