[YARN-7876] Localized jars that are expanded after localization are not fully copied

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Target Version/s: 3.1.0
• Hadoop Flags: Reviewed
• Assignee: Miklos Szegedi
• Reporter: Miklos Szegedi
• Created: 02/Feb/18 05:51
• Updated: 06/Feb/18 18:46
• Resolved: 05/Feb/18 18:45

Description

YARN-2185 added the ability to localize jar files as a stream instead of copying to local disk and then extracting. ZipInputStream does not need the end of the file. Let's read it out. This helps with an additional TeeInputStream on the input.

Issue Links

• breaks: MAPREDUCE-7049 Testcase TestMRJobs#testJobClassloaderWithCustomClasses fails
• is broken by: YARN-2185 Use pipes when localizing archives
• is duplicated by: MAPREDUCE-7049 Testcase TestMRJobs#testJobClassloaderWithCustomClasses fails