Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10285 Storage Policy Satisfier in HDFS
  3. HDFS-10800

[SPS]: Daemon thread in Namenode to find blocks placed in other storage than what the policy specifies

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: HDFS-10285
    • Fix Version/s: HDFS-10285, 3.2.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This JIRA is for implementing a daemon thread called StoragePolicySatisfier in namatode, which scans the asked files blocks which are placed in different storages in DNs than the related policies specifie.

      The idea is:

      1. When user called on some files/dirs to satisfy storage policy, they should have been tracked in NN and then StoragePolicySatisfier thread will pick one by one file, then check the blocks which might have been placed in different storage in DN than what the storage policy is expecting it to.
      2. After checking all, it should also construct the data structures with the required information to move a block from one storage to another.

        Attachments

        1. HDFS-10800-HDFS-10285-05.patch
          47 kB
          Uma Maheswara Rao G
        2. HDFS-10800-HDFS-10285-04.patch
          47 kB
          Uma Maheswara Rao G
        3. HDFS-10800-HDFS-10285-03.patch
          47 kB
          Uma Maheswara Rao G
        4. HDFS-10800-HDFS-10285-02.patch
          46 kB
          Uma Maheswara Rao G
        5. HDFS-10800-HDFS-10285-01.patch
          46 kB
          Uma Maheswara Rao G
        6. HDFS-10800-HDFS-10285-00.patch
          45 kB
          Uma Maheswara Rao G

          Activity

            People

            • Assignee:
              umamaheswararao Uma Maheswara Rao G
              Reporter:
              umamaheswararao Uma Maheswara Rao G
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: