Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12533

staging directories are not deleted after secure bulk load

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.98.6
    • Fix Version/s: 0.98.9, 0.99.2
    • Component/s: regionserver
    • Labels:
      None
    • Environment:

      CDH5.2 + Kerberos

    • Hadoop Flags:
      Reviewed

      Description

      We using secure bulk load heavily in our environment. And it was working with no problem during some time. But last week I found that clients hangs while calling doBulkLoad

      After some investigation I found that HDFS keeps more than 1,000,000 directories in /tmp/hbase-staging directory.

      When directory's content was purged the load process runs successfully.

      According the hbase book

      HBase manages creation and deletion of this directory.
      

        Attachments

        1. HBASE-12533-v2.patch
          8 kB
          Jeffrey Zhong
        2. HBASE-12533.patch
          6 kB
          Jeffrey Zhong

          Issue Links

            Activity

              People

              • Assignee:
                jeffreyz Jeffrey Zhong
                Reporter:
                dubislv Andrejs Dubovskis
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: