Bigtop
  1. Bigtop
  2. BIGTOP-572

Fix HDFS directory values in pseudo-conf hdfs-site.xml for 0.23+ NN/DN/SNN

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.4.0
    • Fix Version/s: 0.4.0
    • Component/s: General
    • Labels:

      Description

      With base pseudo-distributed config packages installed (Which I HUGELY love! Thank you for making starting with hadoop so easy for beginners!) we get:

      NN log:

      12/05/03 17:08:40 WARN common.Util: Path /var/lib/hadoop-hdfs/cache/hdfs/dfs/name should be specified as a URI in configuration files. Please update hdfs configuration.
      12/05/03 17:08:40 WARN common.Util: Path /var/lib/hadoop-hdfs/cache/hdfs/dfs/name should be specified as a URI in configuration files. Please update hdfs configuration.

      DN log:
      2012-05-03 18:39:01,463 WARN org.apache.hadoop.hdfs.server.common.Util: Path /var/lib/hadoop-hdfs/cache/hdfs/dfs/data should be specified as a URI in configuration files. Please update hdfs configuration.

      SNN log:
      2012-05-03 18:43:56,624 WARN org.apache.hadoop.hdfs.server.common.Util: Path /var/lib/hadoop-hdfs/cache/hdfs/dfs/namesecondary should be specified as a URI in configuration files. Please update hdfs configuration.
      2012-05-03 18:43:56,625 WARN org.apache.hadoop.hdfs.server.common.Util: Path /var/lib/hadoop-hdfs/cache/hdfs/dfs/namesecondary should be specified as a URI in configuration files. Please update hdfs configuration.

      We can fix all this up by file:///-prefixing the various HDFS directory properties. Happier admins, lesser confusion.

        Activity

        Hide
        Harsh J added a comment -

        Attached patch, made against trunk, will clear these warnings. This change is ONLY for 0.23+ Hadoop versions, not for earlier Apache releases like 1.x as those won't complain.

        Show
        Harsh J added a comment - Attached patch, made against trunk, will clear these warnings. This change is ONLY for 0.23+ Hadoop versions, not for earlier Apache releases like 1.x as those won't complain.
        Hide
        Harsh J added a comment -

        Btw I tried these out in a 0.23.1-based installation and it worked nicely. No more warnings.

        Show
        Harsh J added a comment - Btw I tried these out in a 0.23.1-based installation and it worked nicely. No more warnings.
        Hide
        Roman Shaposhnik added a comment -

        Harsh, thanks for the kind of words, but most of all thanks for the patch!

        +1 and committed.

        Show
        Roman Shaposhnik added a comment - Harsh, thanks for the kind of words, but most of all thanks for the patch! +1 and committed.
        Hide
        Harsh J added a comment -

        Thanks Roman Shaposhnik. First bigtop contrib, yay.

        Should I mark this as resolved then? Or are you waiting to merge that into some branch as well? Please mark it as resolved on my behalf in case its done

        Show
        Harsh J added a comment - Thanks Roman Shaposhnik . First bigtop contrib, yay. Should I mark this as resolved then? Or are you waiting to merge that into some branch as well? Please mark it as resolved on my behalf in case its done

          People

          • Assignee:
            Roman Shaposhnik
            Reporter:
            Harsh J
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development