Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12547

Adopt server side cleanup for bulk load staging directories

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      Currently we rely on the client to send the clean up request for bulk load staging directories.

      In discussion of HBASE-12533, Enis and I raised similar comment about cleaning up bulk load staging directories from server side.

      We can keep lease on staging directory for bulk load operation. The default lease period should be long enough. After the lease expires, the underlying staging directory would be cleaned.

      This increases the robustness of bulk load process.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                yuzhihong@gmail.com Ted Yu
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: