[HDFS-12518] Re-encryption should handle task cancellation and progress better

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-beta1
• Fix Version/s: 3.0.0
• Component/s: encryption
• Target Version/s: 3.0.0
• Hadoop Flags: Reviewed
• Assignee: Xiao Chen
• Reporter: Xiao Chen
• Created: 20/Sep/17 23:17
• Updated: 02/Oct/19 17:16
• Resolved: 20/Oct/17 23:25

Description

Re-encryption should handle task cancellation and progress tracking better in general.

In a recent internal report, a canceled re-encryption could lead to the progress of the zone being 'Processing' forever. Sending a new cancel command would make it complete, but new re-encryptions for the same zone wouldn't work because the canceled future is not removed.

This jira proposes to fix that, and enhance the currently handling so new command would start from a clean state.

Issue Links

• is broken by: HDFS-10899 Add functionality to re-encrypt EDEKs