[HADOOP-6639] FileSystem.get(..) may be blocked for a long time

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: fs
• Assignee: Unassigned
• Reporter: Tsz-wo Sze
• Created: 17/Mar/10 22:58
• Updated: 17/Mar/10 23:17
• Resolved: 17/Mar/10 23:17

Description

When FileSystem cache is enabled, FileSystem.get(..) will call FileSystem.Cache.get(..), which is a synchronized method. If the lookup fails, a new instance will be initialized. Depends on the FileSystem subclass implementation, the initialization may take a long time. In such case, the FileSystem.Cache lock will be hold and all calls to FileSystem.get(..) by other threads will be blocked for a long time.

In particular, the DistributedFileSystem initialization may take a long time since there are retries. It is even worst if the socket timeout is set to a large value.

Issue Links

• duplicates: HADOOP-6640 FileSystem.get() does RPC retries within a static synchronized block