Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10285 Storage Policy Satisfier in HDFS
  3. HDFS-12911

[SPS]: Modularize the SPS code and expose necessary interfaces for external/internal implementations.

          Details

          • Type: Sub-task
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: None
          • Fix Version/s: HDFS-10285, 3.2.0
          • Component/s: datanode, namenode
          • Labels:
            None

            Description

            One of the key comment from the discussions was to modularize the SPS code, so we can easily plug in the external/internal implementations. This JIRA for doing the necessary refactoring.

            So other comments to handle
            Daryn:

            1. Lock should not kept while executing placement policy.
            1. While starting up the NN, SPS Xattrs checks happen even if feature disabled. This could potentially impact the startup speed.

              Attachments

              1. HDFS-12911.00.patch
                51 kB
                Chris Douglas
              2. HDFS-12911-HDFS-10285-01.patch
                368 kB
                Rakesh R
              3. HDFS-12911-HDFS-10285-02.patch
                84 kB
                Uma Maheswara Rao G
              4. HDFS-12911-HDFS-10285-03.patch
                83 kB
                Uma Maheswara Rao G
              5. HDFS-12911-HDFS-10285-04.patch
                84 kB
                Uma Maheswara Rao G
              6. HDFS-12911-HDFS-10285-05.patch
                86 kB
                Uma Maheswara Rao G

                Issue Links

                requires

                Sub-task - The sub-task of the issue HDFS-12982 [SPS]: Reduce the locking and cleanup the Namesystem access

                • Major - Major loss of function.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      umamaheswararao Uma Maheswara Rao G
                      Reporter:
                      umamaheswararao Uma Maheswara Rao G
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      11 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: