[YARN-8966] Need a state for Localized resources that indicates if the localization is in progress

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Chandni Singh
• Reporter: Chandni Singh
• Created: 01/Nov/18 22:01
• Updated: 01/Nov/18 22:02

Description

Refer YARN-8867.
Following are some existing limitations in the code of ResourceLocalizationService and LocalizedResource that makes it difficult to differentiate the resources which are queued from the ones for which localization is in progress:

1. LocalizedResource state does not differentiate between resources that are queued and the ones which are actually in-progress. For both of them, the state is DOWNLOADING
2. In ResourceLocalizationService.LocalizerRunner, the pending collection holds the resources that are queued as well as submitted. Items from this list is not removed even when they are submitted. They are removed only when the state changes from DOWNLOADING to localized or localization failed.

Issue Links

• is a child of: YARN-8867 Retrieve the status of resource localization