[HIVE-14042] Potential improvements to abort task handling - tez/llap

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Target Version/s: 2.1.2
• Assignee: Siddharth Seth
• Reporter: Siddharth Seth
• Created: 17/Jun/16 01:38
• Updated: 08/Aug/22 09:14

Description

Follow up from HIVE-14003.

• TezProcessor.run() - in case of an abort, throw an interrupt exception instead of falling off. (Falling off cleanly indicates success)
• Potential cleanup when initialize exits early
• MapRecordProcessor: MultiMRInput - waitForAllInputsReady can block if interrupts are swallowed elsewhere. Use changes from TEZ-3302.
• MapRecordProcessor: mergeMapOp handling - this will never be informed about an abort request
• MapRecordProcessor: Likewise, handling of dummyOp
• MapRecordProcessor: Abort handling in MergeFileRecordProcessor
• ReduceRecordProcessor: waitForAllInputsReady. Loop and timed wait after TEZ-3302
• ReduceRecordProcessor: dummyOp handling

Issue Links

• is related to: HIVE-26459 ReduceRecordProcessor: move to using a timeout version of waitForAllInputsReady(TEZ-3302)