[MAPREDUCE-6989] [Umbrella] Uploader tool for Distributed Cache Deploy of the mapreduce framework and dependencies

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Miklos Szegedi
• Reporter: Miklos Szegedi
• Created: 23/Oct/17 22:31
• Updated: 06/Jun/18 15:43
• Resolved: 06/Jun/18 15:43

Description

The proposal is to create a tool that collects all available jars in the Hadoop classpath and adds them to a single tarball file. It then uploads the resulting archive to an HDFS directory. This saves the cluster administrator from having to set this up manually for Distributed Cache Deploy.

Sub-Tasks

• Uploader tool for Distributed Cache Deploy code changes: Resolved
• Uploader tool for Distributed Cache Deploy documentation: Resolved
• Uploader tool for Distributed Cache Implementation on Windows: Open
• mapreduce.application.framework.path localizes into the private directory: Resolved
• Apply erasure coding properly to framework tarball and support plain tar: Resolved
• Uploader tool should ignore symlinks to the same directory: Resolved
• Add the ability to specify a delayed replication count: Resolved
• Add another tool that watches and deletes old frameworks jars based on shared cache CleanerService: Open