Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2525

Race between BlockPoolSliceScanner and append

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 0.23.0, 2.0.0-alpha
    • 0.23.2
    • datanode
    • None
    • Reviewed

    Description

      I wrote a test which runs append() in a loop on a single file with a single replica, appending 0~100 bytes each time. If this races with the BlockPoolSliceScanner, I observe the BlockPoolSliceScanner getting FNFE, then reporting the block as bad to the NN. This causes the writer thread to loop forever on completeFile() since it doesn't see a valid replica.

      Attachments

        1. HDFS-2525.patch
          3 kB
          Brandon Li
        2. HDFS-2525-branch-0.23.patch
          3 kB
          Brandon Li

        Issue Links

          Activity

            People

              brandonli Brandon Li
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: