[HIVE-1225] enhance storage handler interface to allow for atomic operations

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.6.0
• Component/s: HBase Handler, Query Processor
• Assignee: John Sichi
• Reporter: John Sichi
• Created: 10/Mar/10 20:07
• Updated: 16/Jun/10 01:59

Description

For native tables, we support atomic operations such as INSERT by only moving files from tmp to the real location once the operation is complete. Some storage handlers may be able to support something equivalent; e.g. for HBase, we could purge new timestamps if the operation fails. Even if we don't go all the way to two-phase-commit, we could at least enable something that handles most simple cases.

Issue Links

• blocks: HIVE-1232 implement write atomicity in HBase handler
• relates to: HIVE-705 Hive HBase Integration (umbrella)