Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5682 Heterogeneous Storage phase 2 - APIs to expose Storage Types
  3. HDFS-6708

StorageType should be encoded in the block token

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.4.1
    • 3.0.0-alpha4
    • datanode, namenode
    • None
    • Reviewed
    • StorageTypes are now encoded in the BlockTokenIdentifier to ensure that the intended StorageType for writes is not tampered with on it's way through the Client to the Datanode.

    Description

      HDFS-6702 is adding support for file creation based on StorageType.

      The block token is used as a tamper-proof channel for communicating block parameters from the NN to the DN during block creation. The StorageType should be included in this block token.

      Attachments

        1. HDFS-6708.0001.patch
          43 kB
          Ewan Higgs
        2. HDFS-6708.0002.patch
          43 kB
          Ewan Higgs
        3. HDFS-6708.0003.patch
          51 kB
          Ewan Higgs
        4. HDFS-6708.0004.patch
          52 kB
          Ewan Higgs
        5. HDFS-6708.0005.patch
          52 kB
          Ewan Higgs
        6. HDFS-6708.0006.patch
          52 kB
          Ewan Higgs
        7. HDFS-6708.0007.patch
          53 kB
          Ewan Higgs
        8. HDFS-6708.0008.patch
          49 kB
          Christopher Douglas
        9. HDFS-6708.0009.patch
          48 kB
          Christopher Douglas
        10. HDFS-6708.0010.patch
          51 kB
          Christopher Douglas

        Issue Links

          is duplicated by

          Sub-task - The sub-task of the issue HDFS-5391 writeBlock should accept a target storage directory

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-6702 DFSClient should create blocks using StorageType

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-9807 Add an optional StorageID to writes

          • Major - Major loss of function.
          • Resolved
          requires

          Task - A task that needs to be done. HDFS-11026 Convert BlockTokenIdentifier to use Protobuf

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              ehiggs Ewan Higgs
              arp Arpit Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: