[PHOENIX-5250] The accumulated wal files can't be cleaned

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 5.1.0, 5.1.1

Release Note

When updating from an earlier version, and using HBase 2.1.x, HBase 2.2.6 or earlier, HBase 2.3.3 or earlier, or HBase 2.4.0, HBase is unable to clean up WAL files that include data for global indexed tables with the old implementation.

To avoid running out of disk space, use IndexUpgradeTool to upgrade all tables with global indexes, and then restart all region servers as soon as possible.

• Assignee: Unassigned
• Reporter: Jaanai Zhang
• Created: 19/Apr/19 13:32
• Updated: 13/Feb/21 18:13
• Resolved: 13/Feb/21 10:49

Description

Because of the modification of HBASE-20781,  the faked WALEdits won't be filtered, all WALEdits will be saved into Memstore with a status that inMemstore is true(uses WAL->append method).

The family array of IndexedKeyValue is WALEdit.METAFAMILY that is used to describe a fake WALEdit, and it will put into Memstore with WALedits of data table during sync global index.

WAL files can't be cleaned, except for restarting RS, Many WAL files will decrease the percent of disk free.  

 

 

 

Issue Links

• is fixed by: HBASE-25459 WAL can't be cleaned in some scenes
• is related to: PHOENIX-5268 HBase 2.1/2.2 compatibility