Hadoop Common
  1. Hadoop Common
  2. HADOOP-8495

Update Netty to avoid leaking file descriptors during shuffle

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.3, 2.0.0-alpha, 3.0.0
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: build
    • Labels:
      None

      Description

      Netty 3.2.3.Final has a known bug where writes to a closed channel do not have their futures invoked. See Netty-374. This can lead to file descriptor leaks during shuffle as noted in MAPREDUCE-4298.

        Issue Links

          Activity

          Jason Lowe created issue -
          Jason Lowe made changes -
          Field Original Value New Value
          Attachment HADOOP-8495.patch [ 12531429 ]
          Jason Lowe made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Target Version/s 0.23.3, 2.0.1-alpha [ 12320059, 12321441 ]
          Jason Lowe made changes -
          Affects Version/s 2.0.0-alpha [ 12320352 ]
          Affects Version/s 3.0.0 [ 12320357 ]
          Component/s build [ 12311543 ]
          Component/s io [ 12310687 ]
          Thomas Graves made changes -
          Link This issue is duplicated by MAPREDUCE-4298 [ MAPREDUCE-4298 ]
          Thomas Graves made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.23.3 [ 12320059 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Fix Version/s 2.0.2-alpha [ 12322473 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Jason Lowe
              Reporter:
              Jason Lowe
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development