Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10285 Storage Policy Satisfier in HDFS
  3. HDFS-12291

[SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-10285, 3.2.0
    • datanode, namenode
    • None
    • Reviewed

    Description

      For the given source path directory, presently SPS consider only the files immediately under the directory(only one level of scanning) for satisfying the policy. It WON’T do recursive directory scanning and then schedules SPS tasks to satisfy the storage policy of all the files till the leaf node.

      The idea of this jira is to discuss & implement an efficient recursive directory iteration mechanism and satisfies storage policy for all the files under the given directory.

      Attachments

        1. HDFS-12291-HDFS-10285-09.patch
          89 kB
          Surendra Singh Lilhore
        2. HDFS-12291-HDFS-10285-08.patch
          89 kB
          Surendra Singh Lilhore
        3. HDFS-12291-HDFS-10285-07.patch
          87 kB
          Surendra Singh Lilhore
        4. HDFS-12291-HDFS-10285-06.patch
          87 kB
          Surendra Singh Lilhore
        5. HDFS-12291-HDFS-10285-05.patch
          76 kB
          Surendra Singh Lilhore
        6. HDFS-12291-HDFS-10285-04.patch
          76 kB
          Surendra Singh Lilhore
        7. HDFS-12291-HDFS-10285-03.patch
          117 kB
          Surendra Singh Lilhore
        8. HDFS-12291-HDFS-10285-02.patch
          50 kB
          Surendra Singh Lilhore
        9. HDFS-12291-HDFS-10285-01.patch
          33 kB
          Surendra Singh Lilhore

        Issue Links

        depends upon

        Sub-task - The sub-task of the issue HDFS-12225 [SPS]: Optimize extended attributes for tracking SPS movements

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            surendralilhore Surendra Singh Lilhore
            rakeshr Rakesh Radhakrishnan
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment