Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10285 Storage Policy Satisfier in HDFS
  3. HDFS-13033

[SPS]: Implement a mechanism to do file block movements for external SPS

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: HDFS-10285, 3.2.0
    • Component/s: None
    • Labels:
      None

      Description

      HDFS-12911 modularization is introducing BlockMoveTaskHandler interface for moving the file blocks. That will help us to plugin different ways of block move mechanisms, if needed.

      For Internal SPS, we have simple blk movement tasks to target DN descriptors. For external SPS, we should have mechanism to send replaceBlock on target node and have a listener to track the block movement completion. 

      This is the task to implement the ExternalSPSBlockMoveTaskHandler plugin for external SPS.

        Attachments

        1. HDFS-13033-HDFS-10285-00.patch
          30 kB
          Rakesh Radhakrishnan
        2. HDFS-13033-HDFS-10285-01.patch
          71 kB
          Rakesh Radhakrishnan
        3. HDFS-13033-HDFS-10285-02.patch
          73 kB
          Rakesh Radhakrishnan
        4. HDFS-13033-HDFS-10285-03.patch
          75 kB
          Rakesh Radhakrishnan
        5. HDFS-13033-HDFS-10285-04.patch
          77 kB
          Rakesh Radhakrishnan

          Activity

            People

            • Assignee:
              rakeshr Rakesh Radhakrishnan
              Reporter:
              rakeshr Rakesh Radhakrishnan
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: