Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-3373

FileContext HDFS implementation can leak socket caches

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.3, 2.0.0-alpha, 3.0.0
    • Fix Version/s: 0.23.4, 2.0.3-alpha
    • Component/s: hdfs-client
    • Labels:
      None

      Description

      As noted by Nicholas in HDFS-3359, FileContext doesn't have a close() method, and thus never calls DFSClient.close(). This means that, until finalizers run, DFSClient will hold on to its SocketCache object and potentially have a lot of outstanding sockets/fds held on to.

      1. HDFS-3373.branch23.patch
        16 kB
        John George
      2. HDFS-3373.branch-23.patch
        15 kB
        John George
      3. HDFS-3373.trunk.patch
        23 kB
        John George
      4. HDFS-3373.trunk.patch.1
        24 kB
        John George
      5. HDFS-3373.trunk.patch.2
        24 kB
        John George
      6. HDFS-3373.trunk.patch.3
        24 kB
        John George
      7. HDFS-3373.trunk.patch.3
        24 kB
        John George
      8. HDFS-3373.trunk.patch.4
        24 kB
        John George

        Issue Links

          Activity

          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Robert Joseph Evans made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Target Version/s 0.23.3, 2.0.0-alpha [ 12320052, 12320353 ] 2.0.0-alpha, 0.23.3 [ 12320353, 12320052 ]
          Fix Version/s 0.23.4 [ 12320242 ]
          Resolution Fixed [ 1 ]
          John George made changes -
          Status Reopened [ 4 ] Patch Available [ 10002 ]
          Affects Version/s 0.23.3 [ 12320052 ]
          Target Version/s 2.0.0-alpha [ 12320353 ] 2.0.0-alpha, 0.23.3 [ 12320353, 12320052 ]
          John George made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          John George made changes -
          Attachment HDFS-3373.branch23.patch [ 12546899 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 2.0.3-alpha [ 12323274 ]
          Resolution Fixed [ 1 ]
          Tsz Wo Nicholas Sze made changes -
          Hadoop Flags Reviewed [ 10343 ]
          Release Note Attaching a patch for trunk
          John George made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          John George made changes -
          Attachment HDFS-3373.trunk.patch.4 [ 12546571 ]
          John George made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          John George made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          John George made changes -
          Attachment HDFS-3373.trunk.patch.3 [ 12546297 ]
          John George made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          John George made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          John George made changes -
          Attachment HDFS-3373.trunk.patch.3 [ 12546083 ]
          John George made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          John George made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          John George made changes -
          Attachment HDFS-3373.trunk.patch.2 [ 12545606 ]
          John George made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          John George made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          John George made changes -
          Attachment HDFS-3373.trunk.patch.1 [ 12542795 ]
          John George made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          John George made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note Attaching a patch for trunk
          Affects Version/s 3.0.0 [ 12320356 ]
          John George made changes -
          Attachment HDFS-3373.trunk.patch [ 12542653 ]
          John George made changes -
          Attachment HDFS-3373.branch-23.patch [ 12542438 ]
          Tsz Wo Nicholas Sze made changes -
          Link This issue is related to HDFS-3359 [ HDFS-3359 ]
          John George made changes -
          Field Original Value New Value
          Assignee John George [ johnvijoe ]
          Todd Lipcon created issue -

            People

            • Assignee:
              John George
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development