Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15211

EC: File write hangs during close in case of Exception during updatePipeline

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 3.1.1, 3.3.0, 3.2.1
    • Fix Version/s: 3.3.0, 3.1.4, 3.2.2
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      Ec file write hangs during file close, if there is a exception due to closure of slow stream, and number of data streamers failed increase more than parity block.
      Since in the close, the Stream will try to flush all the healthy streamers, but the streamers won't be having any result due to exception. and the streamers will stay stuck.
      Hence the close will also get stuck.

        Attachments

        1. HDFS-15211-01.patch
          3 kB
          Ayush Saxena
        2. HDFS-15211-02.patch
          8 kB
          Ayush Saxena
        3. HDFS-15211-03.patch
          7 kB
          Ayush Saxena
        4. HDFS-15211-04.patch
          4 kB
          Ayush Saxena
        5. HDFS-15211-05.patch
          6 kB
          Ayush Saxena
        6. TestToRepro-01.patch
          3 kB
          Ayush Saxena
        7. Thread-Dump
          207 kB
          Ayush Saxena
        8. Thread-Dump-02
          163 kB
          Ayush Saxena

          Activity

            People

            • Assignee:
              ayushtkn Ayush Saxena
              Reporter:
              ayushtkn Ayush Saxena
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: