Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-455

Make NN and DN handle in a intuitive way comma-separated configuration strings

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.20.1, 0.21.0
    • Fix Version/s: 0.22.0
    • Component/s: datanode, namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The following configuration causes problems:
      <property>
      <name>dfs.data.dir</name>
      <value>/mnt/hstore2/hdfs, /home/foo/dfs</value>
      </property>

      The problem is that the space after the comma causes the second directory for storage to be " /home/foo/dfs" which is in a directory named <SPACE> which contains a sub-dir named "home" in the hadoop datanodes default directory. This will typically cause the user's home partition to fill, but will be very hard for the user to understand since a directory with a whitespace name is hard to understand.

      (ripped from HADOOP-2366)

      1. HDFS-455.patch
        2 kB
        Michele Catasta
      2. hdfs-455.txt
        2 kB
        Todd Lipcon

        Issue Links

          Activity

            People

            • Assignee:
              Michele Catasta
              Reporter:
              Michele Catasta
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development