Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6518

Set SO_KEEPALIVE on shuffle connections

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Shuffle handler does not set SO_KEEPALIVE so we've seen cases where FDs/sockets get stuck in ESTABLISHED state indefinitely because the server did not see the client leave (network cut or otherwise).

      Attachments

        1. YARN-4052.patch
          1.0 kB
          Chang Li
        2. YARN-4052.2.patch
          7 kB
          Chang Li
        3. YARN-4052.3.patch
          7 kB
          Chang Li
        4. MAPREDUCE-6518.4.patch
          5 kB
          Chang Li

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-8894 Set SO_KEEPALIVE on DN server sockets

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              lichangleo Chang Li
              nroberts Nathan Roberts
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: