Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10285 Storage Policy Satisfier in HDFS
  3. HDFS-12911

[SPS]: Modularize the SPS code and expose necessary interfaces for external/internal implementations.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-10285, 3.2.0
    • datanode, namenode
    • None

    Description

      One of the key comment from the discussions was to modularize the SPS code, so we can easily plug in the external/internal implementations. This JIRA for doing the necessary refactoring.

      So other comments to handle
      Daryn:

      1. Lock should not kept while executing placement policy.
      1. While starting up the NN, SPS Xattrs checks happen even if feature disabled. This could potentially impact the startup speed.

      Attachments

        1. HDFS-12911-HDFS-10285-05.patch
          86 kB
          Uma Maheswara Rao G
        2. HDFS-12911-HDFS-10285-04.patch
          84 kB
          Uma Maheswara Rao G
        3. HDFS-12911-HDFS-10285-03.patch
          83 kB
          Uma Maheswara Rao G
        4. HDFS-12911-HDFS-10285-02.patch
          84 kB
          Uma Maheswara Rao G
        5. HDFS-12911-HDFS-10285-01.patch
          368 kB
          Rakesh Radhakrishnan
        6. HDFS-12911.00.patch
          51 kB
          Christopher Douglas

        Issue Links

          requires

          Sub-task - The sub-task of the issue HDFS-12982 [SPS]: Reduce the locking and cleanup the Namesystem access

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              umamaheswararao Uma Maheswara Rao G
              umamaheswararao Uma Maheswara Rao G
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: