Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2028

There are lot of ESTABLISHED socket connetions at 50010 port.

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.20.1, 0.20.3
    • Fix Version/s: None
    • Component/s: datanode
    • Labels:
    • Environment:

      linux server

      Description

      When I load data into tables of hive via hiver cli or hive server, there are always some ESTABLISHED or CLOSE_WAIT status socket connections. And these tcp connections won't be released unless you quit hive or restart hiveserver.

        Activity

        Hide
        Uma Maheswara Rao G added a comment -

        Hi Zhou,
        AFAIK, ESTABLISTED sockets will be from clients. When we are performing some operations, obviously there will be some ESTABLISHED sockets. Question here is, after completing the operations successfully also they are showing? If they are growing and not coming down also problem. Ideally established sockets will be cleaned after completeing the operation with server.

        Thanks
        Uma

        Show
        Uma Maheswara Rao G added a comment - Hi Zhou, AFAIK, ESTABLISTED sockets will be from clients. When we are performing some operations, obviously there will be some ESTABLISHED sockets. Question here is, after completing the operations successfully also they are showing? If they are growing and not coming down also problem. Ideally established sockets will be cleaned after completeing the operation with server. Thanks Uma
        Hide
        Zhou Sheng added a comment -

        I checkout version 0.20.205 from svn (http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-205/) and built the new core jar.
        After replacing the core jar, the problem still retains. When I load data into tables of hive via hiver cli or hive server, there are always some ESTABLISHED status socket connections.

        Show
        Zhou Sheng added a comment - I checkout version 0.20.205 from svn ( http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-205/ ) and built the new core jar. After replacing the core jar, the problem still retains. When I load data into tables of hive via hiver cli or hive server, there are always some ESTABLISHED status socket connections.
        Hide
        Zhou Sheng added a comment -

        Thanks for your reply, and sorry for my late reply. Because the past three days are the Chinese Dragon Boat Festival.
        About HDFS-1836 I have tested the v0.20.3 and the problem continues. Because I saw the fixed version is 0.20.3 and 0.20.205.0. OK, I will test for the version 0.20.205.0. Thank you again!

        Show
        Zhou Sheng added a comment - Thanks for your reply, and sorry for my late reply. Because the past three days are the Chinese Dragon Boat Festival. About HDFS-1836 I have tested the v0.20.3 and the problem continues. Because I saw the fixed version is 0.20.3 and 0.20.205.0. OK, I will test for the version 0.20.205.0. Thank you again!
        Hide
        Matt Foley added a comment -

        There is an open bug related to lots of port 50010 sockets hanging around in CLOSE_WAIT state: HDFS-1836 (bug exists in v20 only, was just fixed a couple weeks ago, in v20 branch; patch pending for v20.205).

        Also, not sure of the port number, but also related to excessive open sockets: HDFS-1057 (comment 13036525), fixed in trunk, 0.21, 0.20-append.

        Show
        Matt Foley added a comment - There is an open bug related to lots of port 50010 sockets hanging around in CLOSE_WAIT state: HDFS-1836 (bug exists in v20 only, was just fixed a couple weeks ago, in v20 branch; patch pending for v20.205). Also, not sure of the port number, but also related to excessive open sockets: HDFS-1057 (comment 13036525 ), fixed in trunk, 0.21, 0.20-append.

          People

          • Assignee:
            Unassigned
            Reporter:
            Zhou Sheng
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:

              Development