Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2471

Splitting logs, we'll make an output file though the region no longer exists

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.90.0
    • None
    • Reviewed

    Description

      The "human unit tester" (Kannan) last night wondered what happens splitting logs and we come across an edit whose region has since been removed. Taking a look, it looks like we'll create the output file and write the edits for the no-longer-extant region anyways. This will leave litter in the filesystem – region split files that will never be used nor removed. This issue is about verifying that indeed this is whats happening (We do SequenceFile.createWriter with the overwrite flag set to true which tracing seems to mean create all intermediary directories – to be verified) and if it indeed is happening, fixing split so unless the region dir exists, don't write out edits.. just drop them.

      Attachments

        1. HBASE-2471-v2.patch
          9 kB
          Jean-Daniel Cryans

        Activity

          People

            jdcryans Jean-Daniel Cryans
            stack Michael Stack
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: