[HBASE-6605] [0.89-fb] Allow bulk loading to continue past failures.

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.89-fb
• Assignee: Amitanand Aiyer
• Reporter: Amitanand Aiyer
• Created: 17/Aug/12 20:37
• Updated: 13/Jun/22 19:02
• Resolved: 06/Mar/13 23:12

Description

Currently, bulk loading a set of files will error out on the first file that it is unable to bulk load.

We have seen internal cases where there are transient failures (dfs/file corruption etc) that may cause a file to not be successfully bulk loaded. It seems useful to have a mode where the bulk load process tries all the input files, even if there is a failure.

Thus, at the end of the process all the files remaining in the original directory are failed files.

Adding a configuration option to enable this behavior. The default behavior is still to error out on the first failure.