Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12184

Avoid redundant ancestor metadata traversals for listStatus child entries.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.7.0
    • None
    • namenode
    • None

    Description

      Creating a file status requires metadata for EC, EZ, storage policies, etc that are computed by traversing up the ancestor inodes. List status will incur the same penalties for all child entries when one traversal is enough. The penalty for large directories is not trivial. Storage policies short-circuit the full traversal. The other lookups should too.

      Attachments

        Activity

          People

            daryn Daryn Sharp
            daryn Daryn Sharp
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: