Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10285 Storage Policy Satisfier in HDFS
  3. HDFS-12911

[SPS]: Modularize the SPS code and expose necessary interfaces for external/internal implementations.

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: HDFS-10285, 3.2.0
    • Component/s: datanode, namenode
    • Labels:
      None

      Description

      One of the key comment from the discussions was to modularize the SPS code, so we can easily plug in the external/internal implementations. This JIRA for doing the necessary refactoring.

      So other comments to handle
      Daryn:

      1. Lock should not kept while executing placement policy.
      1. While starting up the NN, SPS Xattrs checks happen even if feature disabled. This could potentially impact the startup speed.

        Attachments

        1. HDFS-12911-HDFS-10285-05.patch
          86 kB
          Uma Maheswara Rao G
        2. HDFS-12911-HDFS-10285-04.patch
          84 kB
          Uma Maheswara Rao G
        3. HDFS-12911-HDFS-10285-03.patch
          83 kB
          Uma Maheswara Rao G
        4. HDFS-12911-HDFS-10285-02.patch
          84 kB
          Uma Maheswara Rao G
        5. HDFS-12911-HDFS-10285-01.patch
          368 kB
          Rakesh R
        6. HDFS-12911.00.patch
          51 kB
          Chris Douglas

          Issue Links

          requires

          Sub-task - The sub-task of the issue HDFS-12982 [SPS]: Reduce the locking and cleanup the Namesystem access

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                umamaheswararao Uma Maheswara Rao G
                Reporter:
                umamaheswararao Uma Maheswara Rao G
              • Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: