Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3584

Blocks are getting marked as corrupt with append operation under high load.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 2.0.0-alpha
    • None
    • namenode
    • None

    Description

      Scenario:
      =========
      1. There are 2 clients cli1 and cli2 cli1 write a file F1 and not closed
      2. The cli2 will call append on unclosed file and triggers a leaserecovery
      3. Cli1 is closed
      4. Lease recovery is completed and with updated GS in DN and got BlockReport since there is a mismatch in GS the block got corrupted
      5. Now we got a CommitBlockSync this will also fail since the File is already closed by cli1 and state in NN is Finalized

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              brahmareddy Brahma Reddy Battula
              Votes:
              0 Vote for this issue
              Watchers:
              19 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: