Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12184

Avoid redundant ancestor metadata traversals for listStatus child entries.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.7.0
    • Fix Version/s: None
    • Component/s: namenode
    • Labels:
      None
    • Target Version/s:

      Description

      Creating a file status requires metadata for EC, EZ, storage policies, etc that are computed by traversing up the ancestor inodes. List status will incur the same penalties for all child entries when one traversal is enough. The penalty for large directories is not trivial. Storage policies short-circuit the full traversal. The other lookups should too.

        Attachments

          Activity

            People

            • Assignee:
              daryn Daryn Sharp
              Reporter:
              daryn Daryn Sharp
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: