Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-5250

The accumulated wal files can't be cleaned

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.1.0, 5.1.1
    • Component/s: None
    • Labels:
      None
    • Release Note:
      Hide
      When updating from an earlier version, and using HBase 2.1.x, HBase 2.2.6 or earlier, HBase 2.3.3 or earlier, or HBase 2.4.0, HBase is unable to clean up WAL files that include data for global indexed tables with the old implementation.

      To avoid running out of disk space, use IndexUpgradeTool to upgrade all tables with global indexes, and then restart all region servers as soon as possible.
      Show
      When updating from an earlier version, and using HBase 2.1.x, HBase 2.2.6 or earlier, HBase 2.3.3 or earlier, or HBase 2.4.0, HBase is unable to clean up WAL files that include data for global indexed tables with the old implementation. To avoid running out of disk space, use IndexUpgradeTool to upgrade all tables with global indexes, and then restart all region servers as soon as possible.

      Description

      Because of the modification of HBASE-20781,  the faked WALEdits won't be filtered, all WALEdits will be saved into Memstore with a status that inMemstore is true(uses WAL->append method).

      The family array of IndexedKeyValue is WALEdit.METAFAMILY that is used to describe a fake WALEdit, and it will put into Memstore with WALedits of data table during sync global index.

      WAL files can't be cleaned, except for restarting RS, Many WAL files will decrease the percent of disk free.  

       

       

       

        Attachments

        1. image-2019-04-19-21-31-27-888.png
          215 kB
          Jaanai Zhang

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                jaanai Jaanai Zhang
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: