Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15211

EC: File write hangs during close in case of Exception during updatePipeline

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 3.1.1, 3.3.0, 3.2.1
    • 3.3.0, 3.1.4, 3.2.2
    • None
    • None

    Description

      Ec file write hangs during file close, if there is a exception due to closure of slow stream, and number of data streamers failed increase more than parity block.
      Since in the close, the Stream will try to flush all the healthy streamers, but the streamers won't be having any result due to exception. and the streamers will stay stuck.
      Hence the close will also get stuck.

      Attachments

        1. Thread-Dump-02
          163 kB
          Ayush Saxena
        2. Thread-Dump
          207 kB
          Ayush Saxena
        3. TestToRepro-01.patch
          3 kB
          Ayush Saxena
        4. HDFS-15211-05.patch
          6 kB
          Ayush Saxena
        5. HDFS-15211-04.patch
          4 kB
          Ayush Saxena
        6. HDFS-15211-03.patch
          7 kB
          Ayush Saxena
        7. HDFS-15211-02.patch
          8 kB
          Ayush Saxena
        8. HDFS-15211-01.patch
          3 kB
          Ayush Saxena

        Activity

          People

            ayushtkn Ayush Saxena
            ayushtkn Ayush Saxena
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: