Hadoop Common
  1. Hadoop Common
  2. HADOOP-8495

Update Netty to avoid leaking file descriptors during shuffle

        Details

        • Type: Bug Bug
        • Status: Closed
        • Priority: Critical Critical
        • Resolution: Fixed
        • Affects Version/s: 0.23.3, 2.0.0-alpha, 3.0.0
        • Fix Version/s: 0.23.3, 2.0.2-alpha
        • Component/s: build
        • Labels:
          None

          Description

          Netty 3.2.3.Final has a known bug where writes to a closed channel do not have their futures invoked. See Netty-374. This can lead to file descriptor leaks during shuffle as noted in MAPREDUCE-4298.

            Issue Links

            is duplicated by

            Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-4298 NodeManager crashed after running out of file descriptors

            • Critical - Crashes, loss of data, severe memory leak.
            • Resolved

              Activity

                People

                • Assignee:
                  Jason Lowe
                  Reporter:
                  Jason Lowe
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  9 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Development