Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7496

Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.7.0
    • None
    • None

    Description

      We discussed a few FsVolume removal race conditions on the DataNode in HDFS-7489. We should figure out a way to make removing an FsVolume safe.

      Attachments

        1. HDFS-7496.000.patch
          28 kB
          Lei (Eddy) Xu
        2. HDFS-7496.001.patch
          48 kB
          Lei (Eddy) Xu
        3. HDFS-7496.002.patch
          71 kB
          Lei (Eddy) Xu
        4. HDFS-7496.003.patch
          82 kB
          Lei (Eddy) Xu
        5. HDFS-7496.003.patch
          82 kB
          Lei (Eddy) Xu
        6. HDFS-7496.004.patch
          83 kB
          Lei (Eddy) Xu
        7. HDFS-7496.005.patch
          82 kB
          Lei (Eddy) Xu
        8. HDFS-7496.006.patch
          82 kB
          Lei (Eddy) Xu
        9. HDFS-7496.007.patch
          86 kB
          Lei (Eddy) Xu
        10. HDFS-7496-branch-2.000.patch
          77 kB
          Lei (Eddy) Xu

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HDFS-11070 NPE in BlockSender due to race condition

          • Major - Major loss of function.
          • In Progress
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-7660 BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly.

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-7531 Improve the concurrent access on FsVolumeList

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-7489 Incorrect locking in FsVolumeList#checkDirs can hang datanodes

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-7778 Rename FsVolumeListTest to TestFsVolumeList and commit it to branch-2

          • Major - Major loss of function.
          • Closed

          Activity

            People

              eddyxu Lei (Eddy) Xu
              cmccabe Colin McCabe
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: