Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2275

Erroneous detection of corrupted file when namenode fails to allocate any datanodes for newly allocated block

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.15.0
    • 0.16.0
    • None
    • None

    Description

      It can so happen that the namenode allocated a block for a file and then fails to allocate any datanode for this block. The namenode delivers an exception to the client. The client retries. But the block remains associated with the file (until lease expiration). This causes all client retries to fail.

      An fsck (before the lease expires) reports this block as a missing block.

      Attachments

        1. badBlocks1.patch
          5 kB
          Dhruba Borthakur
        2. badBlocks1.patch
          5 kB
          Dhruba Borthakur

        Activity

          People

            dhruba Dhruba Borthakur
            dhruba Dhruba Borthakur
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: