Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10285 Storage Policy Satisfier in HDFS
  3. HDFS-12291

[SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-10285, 3.2.0
    • datanode, namenode
    • None
    • Reviewed

    Description

      For the given source path directory, presently SPS consider only the files immediately under the directory(only one level of scanning) for satisfying the policy. It WON’T do recursive directory scanning and then schedules SPS tasks to satisfy the storage policy of all the files till the leaf node.

      The idea of this jira is to discuss & implement an efficient recursive directory iteration mechanism and satisfies storage policy for all the files under the given directory.

      Attachments

        1. HDFS-12291-HDFS-10285-01.patch
          33 kB
          Surendra Singh Lilhore
        2. HDFS-12291-HDFS-10285-02.patch
          50 kB
          Surendra Singh Lilhore
        3. HDFS-12291-HDFS-10285-03.patch
          117 kB
          Surendra Singh Lilhore
        4. HDFS-12291-HDFS-10285-04.patch
          76 kB
          Surendra Singh Lilhore
        5. HDFS-12291-HDFS-10285-05.patch
          76 kB
          Surendra Singh Lilhore
        6. HDFS-12291-HDFS-10285-06.patch
          87 kB
          Surendra Singh Lilhore
        7. HDFS-12291-HDFS-10285-07.patch
          87 kB
          Surendra Singh Lilhore
        8. HDFS-12291-HDFS-10285-08.patch
          89 kB
          Surendra Singh Lilhore
        9. HDFS-12291-HDFS-10285-09.patch
          89 kB
          Surendra Singh Lilhore

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue HDFS-12225 [SPS]: Optimize extended attributes for tracking SPS movements

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              surendralilhore Surendra Singh Lilhore
              rakeshr Rakesh Radhakrishnan
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: