Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-4787

Numerous leaked CLOSE_WAIT threads from TabletServer

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.8.1
    • Fix Version/s: 1.7.4, 1.9.0, 2.0.0
    • Component/s: None
    • Environment:
      • Ubuntu 14.04
      • HDFS 2.6.0 and 2.5.0 (in the middle of an upgrade cycle)
      • ZooKeeper 3.4.6
      • Accumulo 1.8.1
      • HotSpot 1.8.0_121

      Description

      I'm running into an issue across all environments where TabletServers are occupying a large number of ports in a CLOSED_WAIT state writing to a DataNode at port 50010.  I'm seeing numbers from around 12,000 to 20,000 ports.  In some instances, there were over 68k and it was affecting other applications from getting a free port and they would fail to start (which is how we found this in the first place).

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                adamjshook Adam J Shook
                Reporter:
                adamjshook Adam J Shook
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 5h 50m
                  5h 50m