Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13726

Enforce that FileSystem initializes only a single instance of the requested FileSystem.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • fs
    • None

    Description

      The FileSystem cache is intended to guarantee reuse of instances by multiple call sites or multiple threads. The current implementation does provide this guarantee, but there is a brief race condition window during which multiple threads could perform redundant initialization. If the file system implementation has expensive initialization logic, then this is wasteful. This issue proposes to eliminate that race condition and guarantee initialization of only a single instance.

      Attachments

        1. HADOOP-13726.001.patch
          6 kB
          Manjunath Anand

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HADOOP-13727 S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-6640 FileSystem.get() does RPC retries within a static synchronized block

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Activity

            People

              manju_hadoop Manjunath Anand
              cnauroth Chris Nauroth
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated: