Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7770

Need document for storage type label of data node storage locations under dfs.datanode.data.dir

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.6.0
    • 2.8.0, 2.7.1, 3.0.0-alpha1
    • documentation
    • None
    • Reviewed

    Description

      HDFS-2832 enables support for heterogeneous storages in HDFS, which allows DN as a collection of storages with different types. However, I can't find document on how to label different storage types from the following two documents. I found the information from the design spec. It will be good we document this for admins and users to use the related Archival storage and storage policy features.

      http://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html

      http://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml

      This JIRA is opened to add document for the new storage type labels.

      1. Add an example under ArchivalStorage.html#Configuration section:

        <property>
          <name>dfs.datanode.data.dir</name>
          <value>[DISK]file:///hddata/dn/disk0,  [SSD]file:///hddata/dn/ssd0,[ARCHIVE]file:///hddata/dn/archive0</value>
        </property>
      

      2. Add a short description of [DISK/SSD/ARCHIVE/RAM_DISK] options in hdfs-default.xml#dfs.data.dir and document DISK as storage type if no storage type is labeled in the data node storage location configuration.

      Attachments

        1. HDFS-7700.01.patch
          8 kB
          Xiaoyu Yao
        2. HDFS-7770.00.patch
          2 kB
          Xiaoyu Yao
        3. HDFS-7770.02.patch
          2 kB
          Xiaoyu Yao

        Issue Links

          Activity

            People

              xyao Xiaoyu Yao
              xyao Xiaoyu Yao
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: