Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.23.0
    • Fix Version/s: None
    • Component/s: build
    • Labels:
      None

      Description

      The conf directory situation in the tarball (generated by mvn pacakge -Dtar) is a mess. The top-level conf directory just contains mr2 conf, there are two other incomplete conf dirs:

      hadoop-0.24.0-SNAPSHOT $ ls conf/
      slaves  yarn-env.sh  yarn-site.xml
      hadoop-0.24.0-SNAPSHOT $ find . -name conf
      ./conf
      ./share/hadoop/hdfs/templates/conf
      ./share/hadoop/common/templates/conf
      

      yet there are 4 hdfs-site.xml files:

      hadoop-0.24.0-SNAPSHOT $ find . -name hdfs-site.xml
      ./etc/hadoop/hdfs-site.xml
      ./share/hadoop/hdfs/templates/conf/hdfs-site.xml
      ./share/hadoop/hdfs/templates/hdfs-site.xml
      ./share/hadoop/common/templates/conf/hdfs-site.xml
      

      And it looks like ./share/hadoop/common/templates/conf contains the old MR1 style conf (eg mapred-site.xml).

      We should generate a tarball with a single conf directory that just has common, hdfs and mr2 confs.

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        1158d 15h 8m 1 Allen Wittenauer 08/Feb/15 18:45
        Allen Wittenauer made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Won't Fix [ 2 ]
        Hide
        Allen Wittenauer added a comment -

        Closing as Won't Fix since none of it exists in trunk anymore.

        Show
        Allen Wittenauer added a comment - Closing as Won't Fix since none of it exists in trunk anymore.
        Robert Joseph Evans made changes -
        Target Version/s 0.23.2 [ 12319855 ] 2.0.0, 3.0.0 [ 12320352, 12320357 ]
        Arun C Murthy made changes -
        Target Version/s 0.23.1 [ 12318884 ] 0.23.2 [ 12319855 ]
        Eric Yang made changes -
        Field Original Value New Value
        Assignee Eric Yang [ eyang ]
        Hide
        Eric Yang added a comment -

        There should be only one template copy which has been utilized by hadoop-setup-conf.sh to jump start new comer to configure hadoop clusters.

        ./etc/hadoop/hdfs-site.xml
        ./share/hadoop/common/templates/conf/hdfs-site.xml
        

        It seems there are certain artifacts left over from project refactoring. Some clean up would be nice.

        Show
        Eric Yang added a comment - There should be only one template copy which has been utilized by hadoop-setup-conf.sh to jump start new comer to configure hadoop clusters. ./etc/hadoop/hdfs-site.xml ./share/hadoop/common/templates/conf/hdfs-site.xml It seems there are certain artifacts left over from project refactoring. Some clean up would be nice.
        Hide
        Eli Collins added a comment -

        Have to explicitly set HADOOP_CONF_DIR in hadoop-env.sh for any of the bin and sbin commands to work.

        Show
        Eli Collins added a comment - Have to explicitly set HADOOP_CONF_DIR in hadoop-env.sh for any of the bin and sbin commands to work.
        Hide
        Eli Collins added a comment -

        The hadoop command also doesn't seem to pick up on the top-level conf dir, I have to explicitly pass it to via the "config" option, eg

        hadoop-0.24.0-SNAPSHOT $ ./bin/hadoop --config conf namenode -format 
        
        Show
        Eli Collins added a comment - The hadoop command also doesn't seem to pick up on the top-level conf dir, I have to explicitly pass it to via the "config" option, eg hadoop-0.24.0-SNAPSHOT $ ./bin/hadoop --config conf namenode -format
        Eli Collins created issue -

          People

          • Assignee:
            Eric Yang
            Reporter:
            Eli Collins
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development