Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9812

Streamer threads leak if failure happens when closing DFSOutputStream

          Details

          • Type: Bug
          • Status: Closed
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 2.7.1
          • Fix Version/s: 2.8.0, 2.7.3, 3.0.0-alpha1
          • Component/s: hdfs-client
          • Labels:
            None
          • Hadoop Flags:
            Reviewed

            Description

            In HDFS-9794, it has solved problem of that stream thread leak if failure happens when closing the striped outputstream. And in DFSOutputStream, it also exists the same problem in DFSOutputStream#closeImpl. If failures happen when flushing data blocks, the streamer threads will also not be closed.

              Attachments

              1. HDFS.001.patch
                2 kB
                Yiqun Lin
              2. HDFS-9812.002.patch
                12 kB
                Yiqun Lin
              3. HDFS-9812.003.patch
                4 kB
                Yiqun Lin
              4. HDFS-9812.004.patch
                3 kB
                Yiqun Lin
              5. HDFS-9812.branch-2.patch
                1 kB
                Akira Ajisaka
              6. HDFS-9812-branch-2.7.patch
                2 kB
                Akira Ajisaka

                Issue Links

                relates to

                Sub-task - The sub-task of the issue HDFS-9794 Streamer threads may leak if failure happens when closing the striped outputstream

                • Critical - Crashes, loss of data, severe memory leak.
                • Resolved

                Bug - A problem which impairs or prevents the functions of the product. HDFS-2043 TestHFlush failing intermittently

                • Major - Major loss of function.
                • Closed

                  Activity

                    People

                    • Assignee:
                      linyiqun Yiqun Lin
                      Reporter:
                      linyiqun Yiqun Lin
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      11 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: