Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-455

Make NN and DN handle in a intuitive way comma-separated configuration strings

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.20.1, 0.21.0
    • Fix Version/s: 0.22.0
    • Component/s: datanode, namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The following configuration causes problems:
      <property>
      <name>dfs.data.dir</name>
      <value>/mnt/hstore2/hdfs, /home/foo/dfs</value>
      </property>

      The problem is that the space after the comma causes the second directory for storage to be " /home/foo/dfs" which is in a directory named <SPACE> which contains a sub-dir named "home" in the hadoop datanodes default directory. This will typically cause the user's home partition to fill, but will be very hard for the user to understand since a directory with a whitespace name is hard to understand.

      (ripped from HADOOP-2366)

      1. hdfs-455.txt
        2 kB
        Todd Lipcon
      2. HDFS-455.patch
        2 kB
        Michele Catasta

        Issue Links

          Activity

          Michele Catasta created issue -
          Michele Catasta made changes -
          Field Original Value New Value
          Status Open [ 1 ] Patch Available [ 10002 ]
          Michele Catasta made changes -
          Attachment HDFS-455.patch [ 12412110 ]
          Michele Catasta made changes -
          Link This issue depends on HADOOP-2366 [ HADOOP-2366 ]
          Todd Lipcon made changes -
          Attachment hdfs-455.txt [ 12431502 ]
          Todd Lipcon made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Todd Lipcon made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Todd Lipcon made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Todd Lipcon made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Jakob Homan made changes -
          Assignee Michele Catasta [ pirroh ]
          Eli Collins made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Fix Version/s 0.22.0 [ 12314241 ]
          Resolution Fixed [ 1 ]
          Gavin made changes -
          Link This issue depends on HADOOP-2366 [ HADOOP-2366 ]
          Gavin made changes -
          Link This issue depends upon HADOOP-2366 [ HADOOP-2366 ]

            People

            • Assignee:
              Michele Catasta
              Reporter:
              Michele Catasta
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development