Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9809

Abstract implementation-specific details from the datanode

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-alpha2
    • Component/s: datanode, fs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Multiple parts of the Datanode (FsVolumeSpi, ReplicaInfo, FSVolumeImpl etc.) implicitly assume that blocks are stored in java.io.File(s) and that volumes are divided into directories. We propose to abstract these details, which would help in supporting other storages.

        Attachments

        1. HDFS-9809.001.patch
          229 kB
          Virajith Jalaparti
        2. HDFS-9809.002.patch
          298 kB
          Virajith Jalaparti
        3. HDFS-9809.003.patch
          306 kB
          Virajith Jalaparti
        4. HDFS-9809.004.patch
          348 kB
          Virajith Jalaparti
        5. DFSIO_benchmark_HDFS-9809.docx
          13 kB
          Virajith Jalaparti

          Issue Links

          is depended upon by

          Sub-task - The sub-task of the issue HDFS-10675 [READ] Datanode support to read from external stores.

          • Major - Major loss of function.
          • Resolved
          is related to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-9806 Allow HDFS block replicas to be provided by an external storage system

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                virajith Virajith Jalaparti
                Reporter:
                virajith Virajith Jalaparti
              • Votes:
                0 Vote for this issue
                Watchers:
                19 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: