Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-312

Connections should not be cached

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.6.0
    • ipc
    • None

    Description

      Servers and clients (client include datanodes, tasktrackers, DFSClients & tasks) should not cache connections or maybe cache them for very short periods of time. Clients should set up & tear down connections to the servers everytime they need to contact the servers (including the heartbeats). If connection is cached, then reuse the existing connection for a few subsequent transactions until the connection expires. The heartbeat interval should be more so that many more clients (order of tens of thousands) can be accomodated within 1 heartbeat interval.

      Attachments

        1. no_connection_caching.patch
          9 kB
          Devaraj Das
        2. no_connection_caching.patch
          10 kB
          Devaraj Das
        3. no_conn_caching.patch
          11 kB
          Devaraj Das
        4. no_conn_caching.patch
          12 kB
          Devaraj Das
        5. no_conn_caching.patch
          12 kB
          Devaraj Das
        6. no_conn_caching.patch
          7 kB
          Devaraj Das
        7. no_conn_caching.patch
          7 kB
          Devaraj Das
        8. no_conn_caching.patch
          13 kB
          Devaraj Das
        9. control_conn_caching.patch
          13 kB
          Devaraj Das

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ddas Devaraj Das
            ddas Devaraj Das
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment