[HBASE-12547] Adopt server side cleanup for bulk load staging directories

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Incomplete
• Labels: bulkloader
• Assignee: Unassigned
• Reporter: Ted Yu
• Created: 20/Nov/14 19:48
• Updated: 17/Jun/22 18:36
• Resolved: 17/Jun/22 18:36

Description

Currently we rely on the client to send the clean up request for bulk load staging directories.

In discussion of HBASE-12533, Enis and I raised similar comment about cleaning up bulk load staging directories from server side.

We can keep lease on staging directory for bulk load operation. The default lease period should be long enough. After the lease expires, the underlying staging directory would be cleaned.

This increases the robustness of bulk load process.

Issue Links

• is related to: HBASE-12533 staging directories are not deleted after secure bulk load