Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7199

DFSOutputStream should not silently drop data if DataStreamer crashes with an unchecked exception

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.5.0
    • Fix Version/s: 2.6.0
    • Component/s: hdfs-client
    • Labels:
      None
    • Target Version/s:

      Description

      If the DataStreamer thread encounters a non-I/O exception then it closes the output stream but does not set lastException. When the client later calls close on the output stream then it will see the stream is already closed with lastException == null, mistakently think this is a redundant close call, and fail to report any error to the client.

        Attachments

        1. HDFS-7199.patch
          0.8 kB
          Rushabh Shah
        2. HDFS-7199-1.patch
          0.7 kB
          Rushabh Shah
        3. HDFS-7199-WIP.patch
          0.7 kB
          Chen He

          Activity

            People

            • Assignee:
              shahrs87 Rushabh Shah
              Reporter:
              jlowe Jason Darrell Lowe
            • Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: