[HBASE-12533] staging directories are not deleted after secure bulk load

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.98.6
• Fix Version/s: 0.98.9, 0.99.2
• Component/s: regionserver

Environment

CDH5.2 + Kerberos

• Hadoop Flags: Reviewed
• Assignee: Jeffrey Zhong
• Reporter: Andrejs Dubovskis
• Created: 19/Nov/14 09:01
• Updated: 06/Apr/18 17:55
• Resolved: 27/Nov/14 00:57

Description

We using secure bulk load heavily in our environment. And it was working with no problem during some time. But last week I found that clients hangs while calling doBulkLoad

After some investigation I found that HDFS keeps more than 1,000,000 directories in /tmp/hbase-staging directory.

When directory's content was purged the load process runs successfully.

According the hbase book

HBase manages creation and deletion of this directory.

Issue Links

• relates to: HBASE-12547 Adopt server side cleanup for bulk load staging directories