Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3264

race in removing error edit stream could cause fatalExit()

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.1.0
    • None
    • namenode
    • None

    Description

      An unhealthy storage directory and its edit stream can be removed from editStreams list. There are multiple places to remove unhealthy directory and its stream, such as log sync, checkpointing.

      Method removeEditsStreamsAndStorageDirs() could unneceissarily invoke fatalExit() if another thread removes one error editStream before current thread. This race could be between logSync requests, or between logSync and any place where a storage directory may be removed, e.g., during checkpointing.

      Attachments

        Activity

          People

            brandonli Brandon Li
            brandonli Brandon Li
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: