Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8495

Update Netty to avoid leaking file descriptors during shuffle

          Details

          • Type: Bug
          • Status: Closed
          • Priority: Critical
          • Resolution: Fixed
          • Affects Version/s: 0.23.3, 2.0.0-alpha, 3.0.0-alpha1
          • Fix Version/s: 0.23.3, 2.0.2-alpha
          • Component/s: build
          • Labels:
            None

            Description

            Netty 3.2.3.Final has a known bug where writes to a closed channel do not have their futures invoked. See Netty-374. This can lead to file descriptor leaks during shuffle as noted in MAPREDUCE-4298.

              Attachments

                Issue Links

                is duplicated by

                Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-4298 NodeManager crashed after running out of file descriptors

                • Critical - Crashes, loss of data, severe memory leak.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      jlowe Jason Lowe
                      Reporter:
                      jlowe Jason Lowe
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      8 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: