Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12090 Handling writes from HDFS to Provided storages
  3. HDFS-13310

[PROVIDED Phase 2] The DatanodeProtocol should be have DNA_BACKUP to backup blocks

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • None
    • None
    • HDFS Datanodes now understand DNA_BACKUP command for writing to external storage endpoints.

    Description

      As part of HDFS-12090, Datanodes should be able to receive DatanodeCommands in the heartbeat response that instructs it to backup a block.

      This should take the form of two sub commands: PUT_FILE (when the file is <=1 block in size) and MULTIPART_PUT_PART when part of a Multipart Upload (see HDFS-13186).

      Attachments

        1. HDFS-13310-HDFS-12090.001.patch
          68 kB
          Ewan Higgs
        2. HDFS-13310-HDFS-12090.002.patch
          69 kB
          Ewan Higgs
        3. HDFS-13310-HDFS-12090.003.patch
          68 kB
          Virajith Jalaparti
        4. HDFS-13310-HDFS-12090.004.patch
          68 kB
          Ewan Higgs
        5. HDFS-13310-HDFS-12090.005.patch
          61 kB
          Ewan Higgs
        6. HDFS-13310-HDFS-12090.006.patch
          60 kB
          Virajith Jalaparti
        7. HDFS-13310-HDFS-12090.007.patch
          61 kB
          Virajith Jalaparti

        Issue Links

          links to

          Web Link GitHub Pull Request #1647

          Activity

            People

              ehiggs Ewan Higgs
              ehiggs Ewan Higgs
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: