[HBASE-25230] Embedded zookeeper server not clean up the old data

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.0.0-alpha-1, 1.7.0, 2.4.0, 2.2.7, 2.3.4
• Component/s: Zookeeper
• Hadoop Flags: Reviewed
• Assignee: Laxman Goswami
• Reporter: Rural Hunter
• Created: 30/Oct/20 08:35
• Updated: 04/Dec/20 17:28
• Resolved: 03/Dec/20 09:29

Description

The size of zookeeper data dir keeps increasing. I checked the source code and found the zookeeper data cleanup manager is not started by hbase. The standalone zookeeper server runs the data cleanup manager but hbase does not. I suggest add the code below at the beginning of org.apache.hadoop.hbase.zookeeper.HQuorumPeer.runZKServer():

    // Start and schedule the the purge task
    DatadirCleanupManager purgeMgr=new DatadirCleanupManager(
          zkConfig.getDataDir(),
          zkConfig.getDataLogDir(),
          zkConfig.getSnapRetainCount(),
          zkConfig.getPurgeInterval());
    purgeMgr.start();

I've been running this code in my hbase cluster for quite a long time without problem.

Issue Links

• links to: GitHub Pull Request #2732