Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6959

Make the HDFS home directory location customizable.

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.6.0
    • Component/s: None
    • Labels:
    • Target Version/s:

      Description

      The path is currently hardcoded:
      public Path getHomeDirectory()

      { return makeQualified(new Path("/user/" + dfs.ugi.getShortUserName())); }

      It would be nice to have that as a customizable value.

      Thank you

      1. HDFS-6959.002.patch
        5 kB
        Yongjun Zhang
      2. HDFS-6959.001.patch
        5 kB
        Yongjun Zhang
      3. HADOOP-10334.002.patch
        22 kB
        Yongjun Zhang
      4. HADOOP-10334.002.patch
        22 kB
        Yongjun Zhang
      5. HADOOP-10334.001.patch
        5 kB
        Yongjun Zhang

        Issue Links

          Activity

          Hide
          Yongjun Zhang added a comment -

          HI Kevin Odell, thanks for reporting this issue, I just submitted a patch, hope that solves the problem.

          Show
          Yongjun Zhang added a comment - HI Kevin Odell , thanks for reporting this issue, I just submitted a patch, hope that solves the problem.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12657446/HADOOP-10334.001.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

          org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
          org.apache.hadoop.hdfs.server.namenode.TestProcessCorruptBlocks
          org.apache.hadoop.hdfs.server.namenode.TestNamenodeCapacityReport

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/4356//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/4356//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12657446/HADOOP-10334.001.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover org.apache.hadoop.hdfs.server.namenode.TestProcessCorruptBlocks org.apache.hadoop.hdfs.server.namenode.TestNamenodeCapacityReport +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/4356//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/4356//console This message is automatically generated.
          Hide
          Stephen Chu added a comment -

          Hi, Yongjun Zhang, nice changes! Couple comments/questions.

          Why not camel case home_dir_base? I haven't seen that convention too much in the Hadoop codebase, but perhaps it's something I'm just not familiar with.

          There's a Path(String parent, String child) constructor which might make it easier if you don't want to deal with + "/" + between parent and child, but not a big deal.

          I went through the 3 failing tests, and am pretty confident they're not related to this change.

          Show
          Stephen Chu added a comment - Hi, Yongjun Zhang , nice changes! Couple comments/questions. Why not camel case home_dir_base ? I haven't seen that convention too much in the Hadoop codebase, but perhaps it's something I'm just not familiar with. There's a Path(String parent, String child) constructor which might make it easier if you don't want to deal with + "/" + between parent and child, but not a big deal. I went through the 3 failing tests, and am pretty confident they're not related to this change.
          Hide
          Yongjun Zhang added a comment -

          Thanks Stephen Chu! good comments. I'm in the process of working on new revision because I found I missed quite some other places to change in the initial patch. Will address your comments in new revision.

          Show
          Yongjun Zhang added a comment - Thanks Stephen Chu ! good comments. I'm in the process of working on new revision because I found I missed quite some other places to change in the initial patch. Will address your comments in new revision.
          Hide
          Colin Patrick McCabe added a comment -

          We should also do this for FileContext (see HADOOP-10944.)

          Show
          Colin Patrick McCabe added a comment - We should also do this for FileContext (see HADOOP-10944 .)
          Hide
          Yongjun Zhang added a comment -

          Hi Colin Patrick McCabe, Thanks for linking to HADOOP-10944. I think we can fix these two issues separately. Please correct me if I'm wrong.

          Attached rev 002. Thanks for reviewing.

          Show
          Yongjun Zhang added a comment - Hi Colin Patrick McCabe , Thanks for linking to HADOOP-10944 . I think we can fix these two issues separately. Please correct me if I'm wrong. Attached rev 002. Thanks for reviewing.
          Hide
          Yongjun Zhang added a comment -

          HI Stephen Chu, thanks for your earlier review. Sorry I put this aside for quite some time due to other critical issues. I will appreciate it if you can look at the new rev. Thanks.

          Show
          Yongjun Zhang added a comment - HI Stephen Chu , thanks for your earlier review. Sorry I put this aside for quite some time due to other critical issues. I will appreciate it if you can look at the new rev. Thanks.
          Hide
          Stephen Chu added a comment -

          Thanks for the update, Yongjun Zhang. Will do this upcoming week.

          Show
          Stephen Chu added a comment - Thanks for the update, Yongjun Zhang . Will do this upcoming week.
          Hide
          Yongjun Zhang added a comment -

          Not sure why the test is not triggered, upload the same patch again.

          Show
          Yongjun Zhang added a comment - Not sure why the test is not triggered, upload the same patch again.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12663609/HADOOP-10334.002.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 2 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-tools/hadoop-azure hadoop-tools/hadoop-openstack:

          org.apache.hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer
          org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/4539//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/4539//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12663609/HADOOP-10334.002.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 2 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-tools/hadoop-azure hadoop-tools/hadoop-openstack: org.apache.hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/4539//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/4539//console This message is automatically generated.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12663864/HADOOP-10334.002.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 2 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The test build failed in hadoop-hdfs-project/hadoop-hdfs

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/4540//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/4540//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12663864/HADOOP-10334.002.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 2 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The test build failed in hadoop-hdfs-project/hadoop-hdfs +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/4540//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/4540//console This message is automatically generated.
          Hide
          Colin Patrick McCabe added a comment -

          I don't think this should be a hadoop-common thing. I think it should be an hdfs-specific thing, with an hdfs-specific configuration key.

          Different filesystems have different ways of setting their home directory. For example, FTPFileSystem actually uses the home directory that the FTP server uses (it will connect to the FTP server to find that information). HarFileSystem uses the URI of the har file itself as its home directory. It doesn't make sense for these filesystems to use the same way of determining their home directory that HDFS does. This is especially true for local filesystems-- HDFS normally uses /user/foo, whereas local filesystems on UNIX use /home/foo.

          Since all these filesystems have a different way of setting their home directory already, there is no point in adding a configuration key in common or new methods to the FileSystem base class. Instead, let's just add a configuration key to DFSConfigKeys that solves this specific problem.

          Show
          Colin Patrick McCabe added a comment - I don't think this should be a hadoop-common thing. I think it should be an hdfs-specific thing, with an hdfs-specific configuration key. Different filesystems have different ways of setting their home directory. For example, FTPFileSystem actually uses the home directory that the FTP server uses (it will connect to the FTP server to find that information). HarFileSystem uses the URI of the har file itself as its home directory. It doesn't make sense for these filesystems to use the same way of determining their home directory that HDFS does. This is especially true for local filesystems-- HDFS normally uses /user/foo, whereas local filesystems on UNIX use /home/foo. Since all these filesystems have a different way of setting their home directory already, there is no point in adding a configuration key in common or new methods to the FileSystem base class. Instead, let's just add a configuration key to DFSConfigKeys that solves this specific problem.
          Hide
          Colin Patrick McCabe added a comment -

          I moved this to HDFS. Feel free to move back if you disagree. Thanks for working on this, Yongjun.

          Show
          Colin Patrick McCabe added a comment - I moved this to HDFS. Feel free to move back if you disagree. Thanks for working on this, Yongjun.
          Hide
          Yongjun Zhang added a comment -

          Hi Colin Patrick McCabe, thanks for the review. In that case, would you please take a look at rev 001 instead? the change there is restricted to HDFS. Thanks.

          Show
          Yongjun Zhang added a comment - Hi Colin Patrick McCabe , thanks for the review. In that case, would you please take a look at rev 001 instead? the change there is restricted to HDFS. Thanks.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12663864/HADOOP-10334.002.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 2 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-tools/hadoop-azure hadoop-tools/hadoop-openstack:

          org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7801//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7801//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12663864/HADOOP-10334.002.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 2 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs hadoop-tools/hadoop-azure hadoop-tools/hadoop-openstack: org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7801//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7801//console This message is automatically generated.
          Hide
          Colin Patrick McCabe added a comment -

          In that case, would you please take a look at rev 001 instead? the change there is restricted to HDFS. Thanks

          OK, reviewing v1.

          + private String home_dir_base = DFSConfigKeys.DFS_USER_HOME_BASE_DIR_DEFAULT;

          Should be final

          +<property>
          +  <name>dfs.user.home.base.dir</name>
          +  <value>/user</value>
          +  <description>Base directory of user home.</description>
          +</property>
          

          This description is a bit terse. Maybe something like: the directory to prepend to the user name to get the user's home directory

          looks good aside from that

          Show
          Colin Patrick McCabe added a comment - In that case, would you please take a look at rev 001 instead? the change there is restricted to HDFS. Thanks OK, reviewing v1. + private String home_dir_base = DFSConfigKeys.DFS_USER_HOME_BASE_DIR_DEFAULT; Should be final +<property> + <name>dfs.user.home.base.dir</name> + <value>/user</value> + <description>Base directory of user home.</description> +</property> This description is a bit terse. Maybe something like: the directory to prepend to the user name to get the user's home directory looks good aside from that
          Hide
          Yongjun Zhang added a comment -

          HI Colin Patrick McCabe and Stephen Chu, thanks for the review, I uploaded a new rev HDFS-6959.001.patch to address the comments from both of you.

          + private String home_dir_base = DFSConfigKeys.DFS_USER_HOME_BASE_DIR_DEFAULT;
          Should be final

          Actually it can not because the value is reset in initialize() method based on config setting.
          Would you please take a look at the new revision? thanks.

          Show
          Yongjun Zhang added a comment - HI Colin Patrick McCabe and Stephen Chu , thanks for the review, I uploaded a new rev HDFS-6959 .001.patch to address the comments from both of you. + private String home_dir_base = DFSConfigKeys.DFS_USER_HOME_BASE_DIR_DEFAULT; Should be final Actually it can not because the value is reset in initialize() method based on config setting. Would you please take a look at the new revision? thanks.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12666148/HDFS-6959.001.patch
          against trunk revision 08a9ac7.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

          org.apache.hadoop.hdfs.TestDecommission
          org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract
          org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7879//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7879//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12666148/HDFS-6959.001.patch against trunk revision 08a9ac7. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.TestDecommission org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7879//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7879//console This message is automatically generated.
          Hide
          Yongjun Zhang added a comment -

          HI Colin Patrick McCabe,

          I looked at the test failure in last run, and filed HADOOP-11056 for some of the test failures reported here, and posted a patch there, it might have helped. Appreciate if you could review that altogether.

          Thanks.

          Show
          Yongjun Zhang added a comment - HI Colin Patrick McCabe , I looked at the test failure in last run, and filed HADOOP-11056 for some of the test failures reported here, and posted a patch there, it might have helped. Appreciate if you could review that altogether. Thanks.
          Hide
          Colin Patrick McCabe added a comment -

          Actually it can not because the value is reset in initialize() method based on config setting.

          Oops, you're right. I had forgotten about that initialize() paradigm we use here instead of a constructor.

          Would you please take a look at the new revision? thanks.

          Can we call this "home directory prefix" instead of "home dir base"? It seems clearer. Similarly, homeDirBase -> homeDirectoryPrefix, etc.

          +1 once that's addressed

          Show
          Colin Patrick McCabe added a comment - Actually it can not because the value is reset in initialize() method based on config setting. Oops, you're right. I had forgotten about that initialize() paradigm we use here instead of a constructor. Would you please take a look at the new revision? thanks. Can we call this "home directory prefix" instead of "home dir base"? It seems clearer. Similarly, homeDirBase -> homeDirectoryPrefix, etc. +1 once that's addressed
          Hide
          Yongjun Zhang added a comment -

          Thanks Colin Patrick McCabe, uploaded new rev to address your comments.

          Show
          Yongjun Zhang added a comment - Thanks Colin Patrick McCabe , uploaded new rev to address your comments.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12666332/HDFS-6959.002.patch
          against trunk revision 1dcaba9.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 2.0.3) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs:

          org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs
          org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7888//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7888//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12666332/HDFS-6959.002.patch against trunk revision 1dcaba9. +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs: org.apache.hadoop.hdfs.server.namenode.TestNameEditsConfigs org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7888//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7888//console This message is automatically generated.
          Hide
          Colin Patrick McCabe added a comment -

          Thanks, Yongjun. +1

          Show
          Colin Patrick McCabe added a comment - Thanks, Yongjun. +1
          Hide
          Yongjun Zhang added a comment -

          Many thanks Colin Patrick McCabe!

          Show
          Yongjun Zhang added a comment - Many thanks Colin Patrick McCabe !
          Hide
          Yongjun Zhang added a comment -

          And many thanks Stephen Chu for the initial review too!

          Show
          Yongjun Zhang added a comment - And many thanks Stephen Chu for the initial review too!
          Hide
          Colin Patrick McCabe added a comment -

          Committed to 2.6. Thanks.

          Almost forgot to mention, we should extend this to FileContext.... probably as part of HADOOP-10944

          Show
          Colin Patrick McCabe added a comment - Committed to 2.6. Thanks. Almost forgot to mention, we should extend this to FileContext.... probably as part of HADOOP-10944
          Hide
          Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #670 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/670/)
          HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang (cmccabe: rev f4caedfcbfeae7e2fe7c0e812ddbb087608a5ffd)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestLocalDFS.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
          Show
          Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #670 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/670/ ) HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang (cmccabe: rev f4caedfcbfeae7e2fe7c0e812ddbb087608a5ffd) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestLocalDFS.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
          Hide
          Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #1861 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1861/)
          HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang (cmccabe: rev f4caedfcbfeae7e2fe7c0e812ddbb087608a5ffd)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestLocalDFS.java
          Show
          Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #1861 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1861/ ) HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang (cmccabe: rev f4caedfcbfeae7e2fe7c0e812ddbb087608a5ffd) hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestLocalDFS.java
          Hide
          Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #1886 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1886/)
          HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang (cmccabe: rev f4caedfcbfeae7e2fe7c0e812ddbb087608a5ffd)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestLocalDFS.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
          Show
          Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #1886 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1886/ ) HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang (cmccabe: rev f4caedfcbfeae7e2fe7c0e812ddbb087608a5ffd) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestLocalDFS.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java

            People

            • Assignee:
              Yongjun Zhang
              Reporter:
              Kevin Odell
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development