Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15211

EC: File write hangs during close in case of Exception during updatePipeline

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 3.1.1, 3.3.0, 3.2.1
    • 3.3.0, 3.1.4, 3.2.2
    • None
    • None

    Description

      Ec file write hangs during file close, if there is a exception due to closure of slow stream, and number of data streamers failed increase more than parity block.
      Since in the close, the Stream will try to flush all the healthy streamers, but the streamers won't be having any result due to exception. and the streamers will stay stuck.
      Hence the close will also get stuck.

      Attachments

        1. Thread-Dump
          207 kB
          Ayush Saxena
        2. Thread-Dump-02
          163 kB
          Ayush Saxena
        3. TestToRepro-01.patch
          3 kB
          Ayush Saxena
        4. HDFS-15211-01.patch
          3 kB
          Ayush Saxena
        5. HDFS-15211-02.patch
          8 kB
          Ayush Saxena
        6. HDFS-15211-03.patch
          7 kB
          Ayush Saxena
        7. HDFS-15211-04.patch
          4 kB
          Ayush Saxena
        8. HDFS-15211-05.patch
          6 kB
          Ayush Saxena

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ayushtkn Ayush Saxena Assign to me
            ayushtkn Ayush Saxena
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment