Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11360

SnapshotFileCache causes too many cache refreshes

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.94.19
    • Fix Version/s: 0.98.5, 0.94.22
    • Component/s: None
    • Labels:
      None

      Description

      Right now we decide whether to refresh the cache based on the lastModified timestamp of all the snapshots and those "running" snapshots which is located in the /hbase/.hbase-snapshot/.tmp/<snapshot> directory

      We ran a ExportSnapshot job which takes around 7 minutes between creating the directory and copying all the files.

      Thus the modified time for the
      /hbase/.hbase-snapshot/.tmp directory was 7 minutes earlier than the modified time of the
      /hbase/.hbase-snapshot/.tmp/<snapshot> directory

      Thus the cache refresh happens and doesn't pick up all the files but thinks its up to date as the modified time of the .tmp directory never changes.

      This is a bug as when the export job starts the cache never contains the files for the "running" snapshot and will fail.

        Attachments

        1. HBASE-11360-0.94.patch
          20 kB
          churro morales
        2. 11360-0.98.txt
          20 kB
          Lars Hofhansl
        3. HBASE-11360-0.96.patch
          20 kB
          churro morales

          Issue Links

            Activity

              People

              • Assignee:
                churromorales churro morales
                Reporter:
                churromorales churro morales
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: