Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15211

EC: File write hangs during close in case of Exception during updatePipeline

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 3.1.1, 3.3.0, 3.2.1
    • Fix Version/s: 3.3.0, 3.1.4, 3.2.2
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      Ec file write hangs during file close, if there is a exception due to closure of slow stream, and number of data streamers failed increase more than parity block.
      Since in the close, the Stream will try to flush all the healthy streamers, but the streamers won't be having any result due to exception. and the streamers will stay stuck.
      Hence the close will also get stuck.

        Attachments

        1. Thread-Dump-02
          163 kB
          Ayush Saxena
        2. Thread-Dump
          207 kB
          Ayush Saxena
        3. TestToRepro-01.patch
          3 kB
          Ayush Saxena
        4. HDFS-15211-05.patch
          6 kB
          Ayush Saxena
        5. HDFS-15211-04.patch
          4 kB
          Ayush Saxena
        6. HDFS-15211-03.patch
          7 kB
          Ayush Saxena
        7. HDFS-15211-02.patch
          8 kB
          Ayush Saxena
        8. HDFS-15211-01.patch
          3 kB
          Ayush Saxena

          Activity

            People

            • Assignee:
              ayushtkn Ayush Saxena
              Reporter:
              ayushtkn Ayush Saxena

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment