Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-11557

ViewFileSystem should init mount points lazily

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.6.0
    • Fix Version/s: None
    • Component/s: viewfs
    • Labels:
    • Target Version/s:

      Description

      ViewFs initialization overhead can range from a couple to 10+ seconds linearly increasing with the number of mounted namespaces. Eager initialization is both expensive (especially when multiplied by MR tasks if viewfs is the defaultFS) and also provides for frustrating experience for users interactively working via FsShell with a single mount point (MP) under their user directory. Internal directories should not require MP initialization at all.

        Attachments

        1. HADOOP-11557.001.patch
          37 kB
          Gera Shegalov

          Activity

            People

            • Assignee:
              jira.shegalov Gera Shegalov
              Reporter:
              jira.shegalov Gera Shegalov
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: