Bigtop
  1. Bigtop
  2. BIGTOP-572

Fix HDFS directory values in pseudo-conf hdfs-site.xml for 0.23+ NN/DN/SNN

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.4.0
    • Fix Version/s: 0.4.0
    • Component/s: general
    • Labels:

      Description

      With base pseudo-distributed config packages installed (Which I HUGELY love! Thank you for making starting with hadoop so easy for beginners!) we get:

      NN log:

      12/05/03 17:08:40 WARN common.Util: Path /var/lib/hadoop-hdfs/cache/hdfs/dfs/name should be specified as a URI in configuration files. Please update hdfs configuration.
      12/05/03 17:08:40 WARN common.Util: Path /var/lib/hadoop-hdfs/cache/hdfs/dfs/name should be specified as a URI in configuration files. Please update hdfs configuration.

      DN log:
      2012-05-03 18:39:01,463 WARN org.apache.hadoop.hdfs.server.common.Util: Path /var/lib/hadoop-hdfs/cache/hdfs/dfs/data should be specified as a URI in configuration files. Please update hdfs configuration.

      SNN log:
      2012-05-03 18:43:56,624 WARN org.apache.hadoop.hdfs.server.common.Util: Path /var/lib/hadoop-hdfs/cache/hdfs/dfs/namesecondary should be specified as a URI in configuration files. Please update hdfs configuration.
      2012-05-03 18:43:56,625 WARN org.apache.hadoop.hdfs.server.common.Util: Path /var/lib/hadoop-hdfs/cache/hdfs/dfs/namesecondary should be specified as a URI in configuration files. Please update hdfs configuration.

      We can fix all this up by file:///-prefixing the various HDFS directory properties. Happier admins, lesser confusion.

        Activity

        Harsh J created issue -
        Hide
        Harsh J added a comment -

        Attached patch, made against trunk, will clear these warnings. This change is ONLY for 0.23+ Hadoop versions, not for earlier Apache releases like 1.x as those won't complain.

        Show
        Harsh J added a comment - Attached patch, made against trunk, will clear these warnings. This change is ONLY for 0.23+ Hadoop versions, not for earlier Apache releases like 1.x as those won't complain.
        Harsh J made changes -
        Field Original Value New Value
        Attachment BIGTOP-572.patch [ 12525441 ]
        Harsh J made changes -
        Summary Fix HDFS directory values in pseudo-conf hdfs-site.xml for NN/DN Fix HDFS directory values in pseudo-conf hdfs-site.xml for 0.23+ NN/DN/SNN
        Harsh J made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Harsh J added a comment -

        Btw I tried these out in a 0.23.1-based installation and it worked nicely. No more warnings.

        Show
        Harsh J added a comment - Btw I tried these out in a 0.23.1-based installation and it worked nicely. No more warnings.
        Hide
        Roman Shaposhnik added a comment -

        Harsh, thanks for the kind of words, but most of all thanks for the patch!

        +1 and committed.

        Show
        Roman Shaposhnik added a comment - Harsh, thanks for the kind of words, but most of all thanks for the patch! +1 and committed.
        Hide
        Harsh J added a comment -

        Thanks Roman Shaposhnik. First bigtop contrib, yay.

        Should I mark this as resolved then? Or are you waiting to merge that into some branch as well? Please mark it as resolved on my behalf in case its done

        Show
        Harsh J added a comment - Thanks Roman Shaposhnik . First bigtop contrib, yay. Should I mark this as resolved then? Or are you waiting to merge that into some branch as well? Please mark it as resolved on my behalf in case its done
        Roman Shaposhnik made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Assignee Roman Shaposhnik [ rvs ]
        Fix Version/s 0.4.0 [ 12318889 ]
        Resolution Fixed [ 1 ]
        Gavin made changes -
        Workflow no-reopen-closed, patch-avail [ 12665270 ] patch-available, re-open possible [ 12666137 ]
        Roman Shaposhnik made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        11m 51s 1 Harsh J 03/May/12 14:27
        Patch Available Patch Available Resolved Resolved
        1d 2h 12m 1 Roman Shaposhnik 04/May/12 16:40
        Resolved Resolved Closed Closed
        413d 8h 15m 1 Roman Shaposhnik 22/Jun/13 00:55

          People

          • Assignee:
            Roman Shaposhnik
            Reporter:
            Harsh J
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development