Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10285 Storage Policy Satisfier in HDFS
  3. HDFS-12291

[SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: HDFS-10285, 3.2.0
    • Component/s: datanode, namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      For the given source path directory, presently SPS consider only the files immediately under the directory(only one level of scanning) for satisfying the policy. It WON’T do recursive directory scanning and then schedules SPS tasks to satisfy the storage policy of all the files till the leaf node.

      The idea of this jira is to discuss & implement an efficient recursive directory iteration mechanism and satisfies storage policy for all the files under the given directory.

        Attachments

        1. HDFS-12291-HDFS-10285-09.patch
          89 kB
          Surendra Singh Lilhore
        2. HDFS-12291-HDFS-10285-08.patch
          89 kB
          Surendra Singh Lilhore
        3. HDFS-12291-HDFS-10285-07.patch
          87 kB
          Surendra Singh Lilhore
        4. HDFS-12291-HDFS-10285-06.patch
          87 kB
          Surendra Singh Lilhore
        5. HDFS-12291-HDFS-10285-05.patch
          76 kB
          Surendra Singh Lilhore
        6. HDFS-12291-HDFS-10285-04.patch
          76 kB
          Surendra Singh Lilhore
        7. HDFS-12291-HDFS-10285-03.patch
          117 kB
          Surendra Singh Lilhore
        8. HDFS-12291-HDFS-10285-02.patch
          50 kB
          Surendra Singh Lilhore
        9. HDFS-12291-HDFS-10285-01.patch
          33 kB
          Surendra Singh Lilhore

          Issue Links

            Activity

              People

              • Assignee:
                surendrasingh Surendra Singh Lilhore
                Reporter:
                rakeshr Rakesh Radhakrishnan
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: