Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-25230

Embedded zookeeper server not clean up the old data

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      The size of zookeeper data dir keeps increasing. I checked the source code and found the zookeeper data cleanup manager is not started by hbase. The standalone zookeeper server runs the data cleanup manager but hbase does not. I suggest add the code below at the beginning of org.apache.hadoop.hbase.zookeeper.HQuorumPeer.runZKServer():

          // Start and schedule the the purge task
          DatadirCleanupManager purgeMgr=new DatadirCleanupManager(
                zkConfig.getDataDir(),
                zkConfig.getDataLogDir(),
                zkConfig.getSnapRetainCount(),
                zkConfig.getPurgeInterval());
          purgeMgr.start();
      

      I've been running this code in my hbase cluster for quite a long time without problem.

        Attachments

          Activity

            People

            • Assignee:
              lgoswami Laxman Goswami
              Reporter:
              ruralhunter Rural Hunter

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment