Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-455

Make NN and DN handle in a intuitive way comma-separated configuration strings

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.20.1, 0.21.0
    • 0.22.0
    • datanode, namenode
    • None
    • Reviewed

    Description

      The following configuration causes problems:
      <property>
      <name>dfs.data.dir</name>
      <value>/mnt/hstore2/hdfs, /home/foo/dfs</value>
      </property>

      The problem is that the space after the comma causes the second directory for storage to be " /home/foo/dfs" which is in a directory named <SPACE> which contains a sub-dir named "home" in the hadoop datanodes default directory. This will typically cause the user's home partition to fill, but will be very hard for the user to understand since a directory with a whitespace name is hard to understand.

      (ripped from HADOOP-2366)

      Attachments

        1. hdfs-455.txt
          2 kB
          Todd Lipcon
        2. HDFS-455.patch
          2 kB
          Michele Catasta

        Issue Links

          Activity

            People

              pirroh Michele Catasta
              pirroh Michele Catasta
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: