[HIVE-17695] collapse union all produced directories into delta directory name suffix for MM

• Type: Sub-task
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Transactions
• Assignee: Unassigned
• Reporter: Eugene Koifman
• Created: 04/Oct/17 20:19
• Updated: 23/Aug/19 04:11

Description

this has special handling for writes resulting from Union All query

In full Acid case at least, these subdirs get collapsed in favor of statementId based dir names (delta_x_y_stmtId). It would be cleaner/simpler to make MM follow the same logic. (full acid does it Hive.moveFiles() I think)