Hadoop Common
  1. Hadoop Common
  2. HADOOP-6640

FileSystem.get() does RPC retries within a static synchronized block

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: fs
    • Labels:
      None
    • Environment:

      all

    • Hadoop Flags:
      Reviewed

      Description

      If using FileSystem.get() in a multithreaded environment, and one get() locks because the NN URI is too slow or not responding and retries are in progress, all other get() (for the diffferent users, NN) are blocked.

      the synchronized block in in the static instance of Cache inner class.

      1. getFS.patch
        4 kB
        Hairong Kuang
      2. getFS_yahoo20s.patch
        4 kB
        Hairong Kuang

        Issue Links

          Activity

          Alejandro Abdelnur created issue -
          Tsz Wo Nicholas Sze made changes -
          Field Original Value New Value
          Link This issue is duplicated by HADOOP-6639 [ HADOOP-6639 ]
          Hairong Kuang made changes -
          Assignee Hairong Kuang [ hairong ]
          Hairong Kuang made changes -
          Attachment getFS.patch [ 12440376 ]
          Tsz Wo Nicholas Sze made changes -
          Hadoop Flags [Reviewed]
          Component/s fs [ 12310689 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue relates to HADOOP-2835 [ HADOOP-2835 ]
          Hairong Kuang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hairong Kuang made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.22.0 [ 12314296 ]
          Resolution Fixed [ 1 ]
          Tom White made changes -
          Fix Version/s 0.21.0 [ 12313563 ]
          Fix Version/s 0.22.0 [ 12314296 ]
          Hairong Kuang made changes -
          Link This issue relates to HADOOP-6691 [ HADOOP-6691 ]
          Hairong Kuang made changes -
          Attachment getFS_yahoo20s.patch [ 12443759 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Hairong Kuang
              Reporter:
              Alejandro Abdelnur
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development