[HADOOP-15065] Make mapreduce specific GenericOptionsParser arguments optional

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Marton Elek
• Created: 22/Nov/17 17:12
• Updated: 22/Nov/17 17:12

Description

org.apache.hadoop.util.GenericOptionsParser is widely used to use common arguments in all the command line applications.

Some of the common arguments are really generic:

-D <property=value>               define a value for a given property
-fs <file:///|hdfs://namenode:port> specify default filesystem URL to use, overrides 'fs.defaultFS' property from configurations.
-libjars <jar1,...>               specify a comma-separated list of jar files to be included in the classpath

But some are mapreduce specific:

-jt <local|resourcemanager:port>  specify a ResourceManager
-archives <archive1,...>          specify a comma-separated list of archives to be unarchived on the compute machines

In the review of HDFS-12588 it was suggested to remove/turn off the mapreduce specific arguments if they are not required (for example in case of starting namenode or datanode).