Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-312

Connections should not be cached

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.6.0
    • ipc
    • None

    Description

      Servers and clients (client include datanodes, tasktrackers, DFSClients & tasks) should not cache connections or maybe cache them for very short periods of time. Clients should set up & tear down connections to the servers everytime they need to contact the servers (including the heartbeats). If connection is cached, then reuse the existing connection for a few subsequent transactions until the connection expires. The heartbeat interval should be more so that many more clients (order of tens of thousands) can be accomodated within 1 heartbeat interval.

      Attachments

        1. control_conn_caching.patch
          13 kB
          Devaraj Das
        2. no_conn_caching.patch
          13 kB
          Devaraj Das
        3. no_conn_caching.patch
          7 kB
          Devaraj Das
        4. no_conn_caching.patch
          7 kB
          Devaraj Das
        5. no_conn_caching.patch
          12 kB
          Devaraj Das
        6. no_conn_caching.patch
          12 kB
          Devaraj Das
        7. no_conn_caching.patch
          11 kB
          Devaraj Das
        8. no_connection_caching.patch
          10 kB
          Devaraj Das
        9. no_connection_caching.patch
          9 kB
          Devaraj Das

        Issue Links

          Activity

            People

              ddas Devaraj Das
              ddas Devaraj Das
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: