[YARN-3090] DeletionService can silently ignore deletion task failures

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.1-beta
• Fix Version/s: 2.7.0
• Component/s: nodemanager
• Target Version/s: 2.7.0
• Hadoop Flags: Reviewed
• Assignee: Varun Saxena
• Reporter: Jason Darrell Lowe
• Created: 22/Jan/15 20:56
• Updated: 10/Apr/15 20:10
• Resolved: 10/Feb/15 16:56

Description

If a non-I/O exception occurs while the DeletionService is executing a deletion task then it will be silently ignored. The exception bubbles up to the thread workers of the ScheduledThreadPoolExecutor which simply attaches the throwable to the Future that was returned when the task was scheduled. However the thread pool is used as a fire-and-forget pool, so nothing ever looks at the Future and therefore the exception is never logged.

Issue Links

• is related to: YARN-3088 LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error