Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3263

HttpFS should read HDFS config from Hadoop site.xml files

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 2.0.0-alpha
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently HttpFS reads HDFS client configuration from the httfs-site.xml from any property of the form 'httpfs.hadoop.conf:HADOOP_PROPERTY'

      This is a bit inconvenient.

      Instead we should support a single property 'httpfs.hadoop.configuration.dir' that can be pointed to HADOOP conf/ dir and the core-site.xml and hdfs-site.xml files would be read from there.

      1. HDFS-3263.patch
        36 kB
        Alejandro Abdelnur
      2. HDFS-3263.patch
        34 kB
        Alejandro Abdelnur
      3. HDFS-3263.patch
        34 kB
        Alejandro Abdelnur
      4. HDFS-3263.patch
        32 kB
        Alejandro Abdelnur
      5. HDFS-3263.patch
        32 kB
        Alejandro Abdelnur
      6. HDFS-3263.patch
        27 kB
        Alejandro Abdelnur

        Activity

        Hide
        Alejandro Abdelnur added a comment -

        Now HttpFS, by default, reads the HDFS configuration from the httpfs conf/ dir, which in the TARBALL is the same as for the rest of the Hadoop services.

        Show
        Alejandro Abdelnur added a comment - Now HttpFS, by default, reads the HDFS configuration from the httpfs conf/ dir, which in the TARBALL is the same as for the rest of the Hadoop services.
        Hide
        Daryn Sharp added a comment -

        I've only skimmed the patch. I'm curious if there's a reason why it seems to be hard coding keys instead of using the keys from CommonConfigurationKeysPublic, etc? Ex. "fs.default.name", which appears to be deprecated, instead of FS_DEFAULT_NAME_KEY. Also, why does it need to hardcode the resource files for Configuration?

        Show
        Daryn Sharp added a comment - I've only skimmed the patch. I'm curious if there's a reason why it seems to be hard coding keys instead of using the keys from CommonConfigurationKeysPublic , etc? Ex. "fs.default.name", which appears to be deprecated, instead of FS_DEFAULT_NAME_KEY . Also, why does it need to hardcode the resource files for Configuration ?
        Hide
        Alejandro Abdelnur added a comment -

        @Daryn, the patch does not introduce the use of 'fs.default.name', it was already used. Only testcases adding new references. We coulld get rid of all those in another JIRA. Regarding the resource files (core-site.xml & hdfs-site.xml) being hardcoded, httpfs is a webapp, it does not have hadoop conf/ dir in the classpath, that is why.

        thxs

        Show
        Alejandro Abdelnur added a comment - @Daryn, the patch does not introduce the use of 'fs.default.name', it was already used. Only testcases adding new references. We coulld get rid of all those in another JIRA. Regarding the resource files (core-site.xml & hdfs-site.xml) being hardcoded, httpfs is a webapp, it does not have hadoop conf/ dir in the classpath, that is why. thxs
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12522848/HDFS-3263.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 3 new or modified test files.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests:
        org.apache.hadoop.fs.http.server.TestHttpFSServer

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2283//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2283//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12522848/HDFS-3263.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified test files. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests: org.apache.hadoop.fs.http.server.TestHttpFSServer +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2283//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2283//console This message is automatically generated.
        Hide
        Alejandro Abdelnur added a comment -

        fixing instrumentation testcase to use testcases injected users/groups instead OS ones for root as they seem to differ in different Unix

        Show
        Alejandro Abdelnur added a comment - fixing instrumentation testcase to use testcases injected users/groups instead OS ones for root as they seem to differ in different Unix
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12522893/HDFS-3263.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 4 new or modified test files.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        -1 javac. The applied patch generated 21 javac compiler warnings (more than the trunk's current 20 warnings).

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2285//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2285//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12522893/HDFS-3263.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 4 new or modified test files. +1 javadoc. The javadoc tool did not generate any warning messages. -1 javac. The applied patch generated 21 javac compiler warnings (more than the trunk's current 20 warnings). +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2285//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2285//console This message is automatically generated.
        Hide
        Alejandro Abdelnur added a comment -

        removing spurious import that generated javac warnings

        Show
        Alejandro Abdelnur added a comment - removing spurious import that generated javac warnings
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12522902/HDFS-3263.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 4 new or modified test files.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2286//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2286//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12522902/HDFS-3263.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 4 new or modified test files. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2286//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2286//console This message is automatically generated.
        Hide
        Alejandro Abdelnur added a comment -

        updated patch using, as Daryn suggested, FS_DEFAULT_NAME_KEY constant instead of 'fs.default.name'.

        Show
        Alejandro Abdelnur added a comment - updated patch using, as Daryn suggested, FS_DEFAULT_NAME_KEY constant instead of 'fs.default.name'.
        Hide
        Eli Collins added a comment -

        FileSystemAccessService.java:

        • "hdfs.configuration.dir" should be something like "hadoop.conf.dir", as there's nothing hdfs specific here right?
        • Can you re-use an existing mechanism, eg use HADOOP_CONF_DIR by default and only require the configuration if that's not present?
        • Are core-site.xml and hdfs-site.xml the only files that should be pulled in, eg how about hadoop-policy.xml?
        • Rather than FILE_SYSTEM_SERVICE_CREATED why not use
        • Let's replace NAME_NODE_PROPERTY with FS_DEFAULT_NAME_KEY while we're at it, there shouldn't be any HDFS-specific names in FileSystemAccesService.java
        • Do we need the FILE_SYSTEM_SERVICE_CREATED check? Ie if the proxy is setup correctly can users ever end up with a conf that doesn't have the hadoop conf set. If so should be a one-time initialization level check then a check performed on each call to execute.
        • If a user gets an HO4 error it means "hdfs.configuration.dir" was not defined, so worth including that in the message.
          TestHttpFSServer:
        • Why use "dummy" for fs.default.name? Don't we need to test this pointing to a real NN?
          ServerSetup.apt.vm:
        • Prose should say Hadoop configuration files (vs HDFS configuration files)
        • On a related node is there a test that covers httpfs working w/ a non-HDFS Hadoop filesystem? Would be good to have a test that uses httpfs with local file system to catch the introduction of HDFS-isms. Can punt this to another jira.
        Show
        Eli Collins added a comment - FileSystemAccessService.java: "hdfs.configuration.dir" should be something like "hadoop.conf.dir", as there's nothing hdfs specific here right? Can you re-use an existing mechanism, eg use HADOOP_CONF_DIR by default and only require the configuration if that's not present? Are core-site.xml and hdfs-site.xml the only files that should be pulled in, eg how about hadoop-policy.xml? Rather than FILE_SYSTEM_SERVICE_CREATED why not use Let's replace NAME_NODE_PROPERTY with FS_DEFAULT_NAME_KEY while we're at it, there shouldn't be any HDFS-specific names in FileSystemAccesService.java Do we need the FILE_SYSTEM_SERVICE_CREATED check? Ie if the proxy is setup correctly can users ever end up with a conf that doesn't have the hadoop conf set. If so should be a one-time initialization level check then a check performed on each call to execute. If a user gets an HO4 error it means "hdfs.configuration.dir" was not defined, so worth including that in the message. TestHttpFSServer: Why use "dummy" for fs.default.name? Don't we need to test this pointing to a real NN? ServerSetup.apt.vm: Prose should say Hadoop configuration files (vs HDFS configuration files) On a related node is there a test that covers httpfs working w/ a non-HDFS Hadoop filesystem? Would be good to have a test that uses httpfs with local file system to catch the introduction of HDFS-isms. Can punt this to another jira.
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12522958/HDFS-3263.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 4 new or modified test files.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2287//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2287//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12522958/HDFS-3263.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 4 new or modified test files. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2287//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2287//console This message is automatically generated.
        Hide
        Alejandro Abdelnur added a comment -

        updated patch based on Eli's feedback (thx!!)

        Follow ups on the non-integrated comments.

        FileSystemAccessService.java:

        • Can you re-use an existing mechanism, eg use HADOOP_CONF_DIR by default and only require the configuration if that's not present?

        TUCU: No we cannot, the current mechanism relies on having the HADOOP_CONF_DIR in the classpath. HttpFS does not have HADOOP_CONF_DIR in the classpath (furthermore, it can run in a setup where there is no other hadoop component installed)

        • Are core-site.xml and hdfs-site.xml the only files that should be pulled in, eg how about hadoop-policy.xml?

        TUCU: was not aware of the hadoop-policy.xml but how would the be used in HttpFS context?

        • Do we need the FILE_SYSTEM_SERVICE_CREATED check? Ie if the proxy is setup correctly can users ever end up with a conf that doesn't have the hadoop conf set. If so should be a one-time initialization level check then a check performed on each call to execute.

        This check is to prevent httpfs code (got bitten by this) to create and use a Configuration object without the hadoop confs in it (per first bullet item)

        • If a user gets an HO4 error it means "hdfs.configuration.dir" was not defined, so worth including that in the message.

        If hdfs.configuration.dir is not defined HttpFS conf dir is used. H04 is for other thing (when a Configuration object not created by FSAS is used, see previous bullet item).


        On a related node is there a test that covers httpfs working w/ a non-HDFS Hadoop filesystem? Would be good to have a test that uses httpfs with local file system to catch the introduction of HDFS-isms. Can punt this to another jira.

        yeah, good idea, will do.

        Show
        Alejandro Abdelnur added a comment - updated patch based on Eli's feedback (thx!!) Follow ups on the non-integrated comments. FileSystemAccessService.java: Can you re-use an existing mechanism, eg use HADOOP_CONF_DIR by default and only require the configuration if that's not present? TUCU: No we cannot, the current mechanism relies on having the HADOOP_CONF_DIR in the classpath. HttpFS does not have HADOOP_CONF_DIR in the classpath (furthermore, it can run in a setup where there is no other hadoop component installed) Are core-site.xml and hdfs-site.xml the only files that should be pulled in, eg how about hadoop-policy.xml? TUCU: was not aware of the hadoop-policy.xml but how would the be used in HttpFS context? Do we need the FILE_SYSTEM_SERVICE_CREATED check? Ie if the proxy is setup correctly can users ever end up with a conf that doesn't have the hadoop conf set. If so should be a one-time initialization level check then a check performed on each call to execute. This check is to prevent httpfs code (got bitten by this) to create and use a Configuration object without the hadoop confs in it (per first bullet item) If a user gets an HO4 error it means "hdfs.configuration.dir" was not defined, so worth including that in the message. If hdfs.configuration.dir is not defined HttpFS conf dir is used. H04 is for other thing (when a Configuration object not created by FSAS is used, see previous bullet item). On a related node is there a test that covers httpfs working w/ a non-HDFS Hadoop filesystem? Would be good to have a test that uses httpfs with local file system to catch the introduction of HDFS-isms. Can punt this to another jira. yeah, good idea, will do.
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12523025/HDFS-3263.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 4 new or modified test files.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2291//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2291//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12523025/HDFS-3263.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 4 new or modified test files. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/2291//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/2291//console This message is automatically generated.
        Hide
        Alejandro Abdelnur added a comment -

        One additional comment regarding how hadoop config files are loaded, the current mechanism will easily enable (with minor changes) to have a single HttpFS servicing multiple filesystems simultaneously via virtual hosts (the hostname would determine with site configs to use). Oozie already has such mechanism in place to work with multiple cluster using the config of each one of them. I'll open a JIRA for this as well.

        Show
        Alejandro Abdelnur added a comment - One additional comment regarding how hadoop config files are loaded, the current mechanism will easily enable (with minor changes) to have a single HttpFS servicing multiple filesystems simultaneously via virtual hosts (the hostname would determine with site configs to use). Oozie already has such mechanism in place to work with multiple cluster using the config of each one of them. I'll open a JIRA for this as well.
        Hide
        Eli Collins added a comment -

        TUCU: No we cannot, the current mechanism relies on having the HADOOP_CONF_DIR in the classpath. HttpFS does not have HADOOP_CONF_DIR in the classpath (furthermore, it can run in a setup where there is no other hadoop component installed)

        I was thinking that it might make sense to keep the mechanism the same so that we don't have two separate ways to specify the conf dir (a HADOOP_CONF_DIR env dir being the normal way hadoop clients locate config vs the new "config.dir" parameter that essentially does the same). I don't feel strongly.

        TUCU: was not aware of the hadoop-policy.xml but how would the be used in HttpFS context?

        I checked and it looks like all the relevant keys are only used on the server side so I don't think you need to include it here.

        This check is to prevent httpfs code (got bitten by this) to create and use a Configuration object without the hadoop confs in it (per first bullet item)

        Makes sense.

        +1 modulo the following nits

        Nit: How about renaming "config.dir" to "hadoop.conf.dir"
        Nit: HttpFSServerWebApp line is way over 80 chars now, please re-format

        Show
        Eli Collins added a comment - TUCU: No we cannot, the current mechanism relies on having the HADOOP_CONF_DIR in the classpath. HttpFS does not have HADOOP_CONF_DIR in the classpath (furthermore, it can run in a setup where there is no other hadoop component installed) I was thinking that it might make sense to keep the mechanism the same so that we don't have two separate ways to specify the conf dir (a HADOOP_CONF_DIR env dir being the normal way hadoop clients locate config vs the new "config.dir" parameter that essentially does the same). I don't feel strongly. TUCU: was not aware of the hadoop-policy.xml but how would the be used in HttpFS context? I checked and it looks like all the relevant keys are only used on the server side so I don't think you need to include it here. This check is to prevent httpfs code (got bitten by this) to create and use a Configuration object without the hadoop confs in it (per first bullet item) Makes sense. +1 modulo the following nits Nit: How about renaming "config.dir" to "hadoop.conf.dir" Nit: HttpFSServerWebApp line is way over 80 chars now, please re-format
        Hide
        Alejandro Abdelnur added a comment -

        Thanks Eli.

        Attaching patch addressing your second NIT.

        The first NIT is not a NIT, the property name is 'httpfs.hadoop.config.dir', there is name aggregation of server/service.

        Show
        Alejandro Abdelnur added a comment - Thanks Eli. Attaching patch addressing your second NIT. The first NIT is not a NIT, the property name is 'httpfs.hadoop.config.dir', there is name aggregation of server/service.
        Hide
        Alejandro Abdelnur added a comment -

        committed to trunk and branch-2.

        Show
        Alejandro Abdelnur added a comment - committed to trunk and branch-2.
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #2097 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2097/)
        HDFS-3263. HttpFS should read HDFS config from Hadoop site.xml files (tucu) (Revision 1327627)

        Result = SUCCESS
        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327627
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServer.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebApp.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccess.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccessException.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/hadoop/FileSystemAccessService.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/resources/httpfs-default.xml
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/site/apt/ServerSetup.apt.vm
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFileSystem.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/lib/service/hadoop/TestFileSystemAccessService.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HadoopUsersConfTestHelper.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #2097 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2097/ ) HDFS-3263 . HttpFS should read HDFS config from Hadoop site.xml files (tucu) (Revision 1327627) Result = SUCCESS tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327627 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServer.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebApp.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccess.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccessException.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/hadoop/FileSystemAccessService.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/resources/httpfs-default.xml /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/site/apt/ServerSetup.apt.vm /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFileSystem.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/lib/service/hadoop/TestFileSystemAccessService.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HadoopUsersConfTestHelper.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #2170 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2170/)
        HDFS-3263. HttpFS should read HDFS config from Hadoop site.xml files (tucu) (Revision 1327627)

        Result = SUCCESS
        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327627
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServer.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebApp.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccess.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccessException.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/hadoop/FileSystemAccessService.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/resources/httpfs-default.xml
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/site/apt/ServerSetup.apt.vm
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFileSystem.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/lib/service/hadoop/TestFileSystemAccessService.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HadoopUsersConfTestHelper.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #2170 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2170/ ) HDFS-3263 . HttpFS should read HDFS config from Hadoop site.xml files (tucu) (Revision 1327627) Result = SUCCESS tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327627 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServer.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebApp.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccess.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccessException.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/hadoop/FileSystemAccessService.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/resources/httpfs-default.xml /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/site/apt/ServerSetup.apt.vm /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFileSystem.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/lib/service/hadoop/TestFileSystemAccessService.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HadoopUsersConfTestHelper.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #2114 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2114/)
        HDFS-3263. HttpFS should read HDFS config from Hadoop site.xml files (tucu) (Revision 1327627)

        Result = SUCCESS
        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327627
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServer.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebApp.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccess.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccessException.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/hadoop/FileSystemAccessService.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/resources/httpfs-default.xml
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/site/apt/ServerSetup.apt.vm
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFileSystem.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/lib/service/hadoop/TestFileSystemAccessService.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HadoopUsersConfTestHelper.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #2114 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2114/ ) HDFS-3263 . HttpFS should read HDFS config from Hadoop site.xml files (tucu) (Revision 1327627) Result = SUCCESS tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327627 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServer.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebApp.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccess.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccessException.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/hadoop/FileSystemAccessService.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/resources/httpfs-default.xml /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/site/apt/ServerSetup.apt.vm /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFileSystem.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/lib/service/hadoop/TestFileSystemAccessService.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HadoopUsersConfTestHelper.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #1019 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1019/)
        HDFS-3263. HttpFS should read HDFS config from Hadoop site.xml files (tucu) (Revision 1327627)

        Result = FAILURE
        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327627
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServer.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebApp.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccess.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccessException.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/hadoop/FileSystemAccessService.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/resources/httpfs-default.xml
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/site/apt/ServerSetup.apt.vm
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFileSystem.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/lib/service/hadoop/TestFileSystemAccessService.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HadoopUsersConfTestHelper.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1019 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1019/ ) HDFS-3263 . HttpFS should read HDFS config from Hadoop site.xml files (tucu) (Revision 1327627) Result = FAILURE tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327627 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServer.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebApp.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccess.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccessException.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/hadoop/FileSystemAccessService.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/resources/httpfs-default.xml /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/site/apt/ServerSetup.apt.vm /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFileSystem.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/lib/service/hadoop/TestFileSystemAccessService.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HadoopUsersConfTestHelper.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #1054 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1054/)
        HDFS-3263. HttpFS should read HDFS config from Hadoop site.xml files (tucu) (Revision 1327627)

        Result = SUCCESS
        tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327627
        Files :

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServer.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebApp.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccess.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccessException.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/hadoop/FileSystemAccessService.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/resources/httpfs-default.xml
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/site/apt/ServerSetup.apt.vm
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFileSystem.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/lib/service/hadoop/TestFileSystemAccessService.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HadoopUsersConfTestHelper.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1054 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1054/ ) HDFS-3263 . HttpFS should read HDFS config from Hadoop site.xml files (tucu) (Revision 1327627) Result = SUCCESS tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1327627 Files : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServer.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/HttpFSServerWebApp.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccess.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/FileSystemAccessException.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/lib/service/hadoop/FileSystemAccessService.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/resources/httpfs-default.xml /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/site/apt/ServerSetup.apt.vm /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/TestHttpFSFileSystem.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/server/TestHttpFSServer.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/lib/service/hadoop/TestFileSystemAccessService.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/test/HadoopUsersConfTestHelper.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

          People

          • Assignee:
            Alejandro Abdelnur
            Reporter:
            Alejandro Abdelnur
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development