Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-25230

Embedded zookeeper server not clean up the old data

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      The size of zookeeper data dir keeps increasing. I checked the source code and found the zookeeper data cleanup manager is not started by hbase. The standalone zookeeper server runs the data cleanup manager but hbase does not. I suggest add the code below at the beginning of org.apache.hadoop.hbase.zookeeper.HQuorumPeer.runZKServer():

          // Start and schedule the the purge task
          DatadirCleanupManager purgeMgr=new DatadirCleanupManager(
                zkConfig.getDataDir(),
                zkConfig.getDataLogDir(),
                zkConfig.getSnapRetainCount(),
                zkConfig.getPurgeInterval());
          purgeMgr.start();
      

      I've been running this code in my hbase cluster for quite a long time without problem.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                lgoswami Laxman Goswami
                Reporter:
                ruralhunter Rural Hunter
              • Votes:
                1 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: