Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.23.0
    • Fix Version/s: None
    • Component/s: build
    • Labels:
      None

      Description

      The conf directory situation in the tarball (generated by mvn pacakge -Dtar) is a mess. The top-level conf directory just contains mr2 conf, there are two other incomplete conf dirs:

      hadoop-0.24.0-SNAPSHOT $ ls conf/
      slaves  yarn-env.sh  yarn-site.xml
      hadoop-0.24.0-SNAPSHOT $ find . -name conf
      ./conf
      ./share/hadoop/hdfs/templates/conf
      ./share/hadoop/common/templates/conf
      

      yet there are 4 hdfs-site.xml files:

      hadoop-0.24.0-SNAPSHOT $ find . -name hdfs-site.xml
      ./etc/hadoop/hdfs-site.xml
      ./share/hadoop/hdfs/templates/conf/hdfs-site.xml
      ./share/hadoop/hdfs/templates/hdfs-site.xml
      ./share/hadoop/common/templates/conf/hdfs-site.xml
      

      And it looks like ./share/hadoop/common/templates/conf contains the old MR1 style conf (eg mapred-site.xml).

      We should generate a tarball with a single conf directory that just has common, hdfs and mr2 confs.

        Activity

        Hide
        Allen Wittenauer added a comment -

        Closing as Won't Fix since none of it exists in trunk anymore.

        Show
        Allen Wittenauer added a comment - Closing as Won't Fix since none of it exists in trunk anymore.
        Hide
        Eric Yang added a comment -

        There should be only one template copy which has been utilized by hadoop-setup-conf.sh to jump start new comer to configure hadoop clusters.

        ./etc/hadoop/hdfs-site.xml
        ./share/hadoop/common/templates/conf/hdfs-site.xml
        

        It seems there are certain artifacts left over from project refactoring. Some clean up would be nice.

        Show
        Eric Yang added a comment - There should be only one template copy which has been utilized by hadoop-setup-conf.sh to jump start new comer to configure hadoop clusters. ./etc/hadoop/hdfs-site.xml ./share/hadoop/common/templates/conf/hdfs-site.xml It seems there are certain artifacts left over from project refactoring. Some clean up would be nice.
        Hide
        Eli Collins added a comment -

        Have to explicitly set HADOOP_CONF_DIR in hadoop-env.sh for any of the bin and sbin commands to work.

        Show
        Eli Collins added a comment - Have to explicitly set HADOOP_CONF_DIR in hadoop-env.sh for any of the bin and sbin commands to work.
        Hide
        Eli Collins added a comment -

        The hadoop command also doesn't seem to pick up on the top-level conf dir, I have to explicitly pass it to via the "config" option, eg

        hadoop-0.24.0-SNAPSHOT $ ./bin/hadoop --config conf namenode -format 
        
        Show
        Eli Collins added a comment - The hadoop command also doesn't seem to pick up on the top-level conf dir, I have to explicitly pass it to via the "config" option, eg hadoop-0.24.0-SNAPSHOT $ ./bin/hadoop --config conf namenode -format

          People

          • Assignee:
            Eric Yang
            Reporter:
            Eli Collins
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development