Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4911

Reduce PeerCache timeout to be commensurate with dfs.datanode.socket.reuse.keepalive

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.4.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      The default timeout for the client's PeerCache is much longer than the DataNode would possibly keep the socket open. Specifically, dfs.client.socketcache.expiryMsec defaults to 2 *
      60 * 1000 (2 minutes), whereas dfs.datanode.socket.reuse.keepalive
      defaults to 1000 (1 second). We should make these more similar to minimize situations where the client tries to use sockets which have gone stale.

        Attachments

        1. HDFS-4911.001.patch
          13 kB
          Colin P. McCabe

          Activity

            People

            • Assignee:
              cmccabe Colin P. McCabe
              Reporter:
              cmccabe Colin P. McCabe
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: