[HBASE-28664] [HBASE] The Archives folder in the HBASE root directory starts to grow uncontrollably under load

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Assignee: Unassigned
• Reporter: Vladislav Timchenko
• Created: 14/Jun/24 08:12
• Updated: 26/Jun/24 07:10
• Resolved: 26/Jun/24 07:10

Description

If there are empty .snapshotinfo and data.manifest in .hbase-snapshot dir, we got a lot of this warns on master server

WARN  [snapshot-hfile-cleaner-cache-refresher] snapshot.SnapshotFileCache: Failed to refresh snapshot hfile cache!
org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: Couldn't read snapshot info from:hdfs://host/apps/hbase/data/.hbase-snapshot/test/.snapshotinfo

how to reproduce:

• create a folder (for example snap2) at the path /apps/base/data/.base-snapshot
• create two empty files there: .snapshotinfo data.manifest
• give a load, for example like this: hbase lt -write 1:10:100 -num_keys 1000000 -read 100:30 -num_tablets 20 -data_block_encoding NONE -tn load_test_tool
• wait...
• the /apps/base/data/archive folder will start to grow (approximately to the size of /apps/base/data/data)
• if you delete the previously created snap2 folder, the size of /aps/base/data/archive will return to its original state