Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4911

Reduce PeerCache timeout to be commensurate with dfs.datanode.socket.reuse.keepalive

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 2.4.0
    • None
    • None

    Description

      The default timeout for the client's PeerCache is much longer than the DataNode would possibly keep the socket open. Specifically, dfs.client.socketcache.expiryMsec defaults to 2 *
      60 * 1000 (2 minutes), whereas dfs.datanode.socket.reuse.keepalive
      defaults to 1000 (1 second). We should make these more similar to minimize situations where the client tries to use sockets which have gone stale.

      Attachments

        1. HDFS-4911.001.patch
          13 kB
          Colin McCabe

        Activity

          People

            cmccabe Colin McCabe
            cmccabe Colin McCabe
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: