Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6850

Shuffle Handler keep-alive connections are closed from the server side

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha4, 2.8.2
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When performance testing tez shuffle handler (TEZ-3334), it was noticed the keep-alive connections are closed from the server-side. The client silently recovers and logs the connection as keep-alive, despite reestablishing a connection. This jira aims to remove the close from the server side, fixing the bug preventing keep-alive connections.

        Attachments

        1. MAPREDUCE-6850.1.patch
          7 kB
          Jonathan Turner Eagles
        2. MAPREDUCE-6850.2.patch
          10 kB
          Jonathan Turner Eagles
        3. MAPREDUCE-6850.3.patch
          10 kB
          Jonathan Turner Eagles
        4. MAPREDUCE-6850.4.patch
          10 kB
          Jonathan Turner Eagles
        5. MAPREDUCE-6850.5.patch
          11 kB
          Jonathan Turner Eagles
        6. MAPREDUCE-6850.6.patch
          12 kB
          Jonathan Turner Eagles
        7. MAPREDUCE-6850.7.patch
          13 kB
          Jonathan Turner Eagles
        8. With_Issue.png
          224 kB
          Rajesh Balamohan
        9. With_Patch_withData.png
          482 kB
          Rajesh Balamohan
        10. With_Patch.png
          501 kB
          Rajesh Balamohan

          Issue Links

          is part of

          Bug - A problem which impairs or prevents the functions of the product. HIVE-16044 LLAP: Shuffle Handler keep-alive connections are closed from the server side

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          relates to

          Sub-task - The sub-task of the issue MAPREDUCE-5787 Modify ShuffleHandler to support Keep-Alive

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Sub-task - The sub-task of the issue TEZ-3633 Implement keep-alive timeout in tez shuffle handler

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                jeagles Jonathan Turner Eagles
                Reporter:
                jeagles Jonathan Turner Eagles
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: