Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1836

Thousand of CLOSE_WAIT socket

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20.2
    • 0.20.3, 0.20.205.0
    • hdfs-client
    • None
    • Linux 2.6.18-194.32.1.el5 #1 SMP Wed Jan 5 17:52:25 EST 2011 x86_64 x86_64 x86_64 GNU/Linux
      java version "1.6.0_23"
      Java(TM) SE Runtime Environment (build 1.6.0_23-b05)
      Java HotSpot(TM) 64-Bit Server VM (build 19.0-b09, mixed mode)

    • Reviewed

    Description

      $ /usr/sbin/lsof -i TCP:50010 | grep -c CLOSE_WAIT
      4471

      It is better if everything runs normal.
      However, from time to time there are some "DataStreamer Exception: java.net.SocketTimeoutException" and "DFSClient.processDatanodeError(2507) | Error Recovery for" can be found from log file and the number of CLOSE_WAIT socket just keep increasing

      The CLOSE_WAIT handles may remain for hours and days; then "Too many open file" some day.

      Attachments

        1. patch-draft-1836.patch
          2 kB
          Dennis Cheung
        2. hdfs-1836-0.20.txt
          2 kB
          Todd Lipcon
        3. hdfs-1836-0.20.txt
          2 kB
          Todd Lipcon
        4. hdfs-1836-0.20.205.txt
          1 kB
          Bharath Mundlapudi

        Activity

          People

            bharathm Bharath Mundlapudi
            hkdennis2k Dennis Cheung
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: