[PIG-3283] job launcher should set mapreduce.client.genericoptionsparser.used property to suppress warning messages

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 0.11.1
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 19/Apr/13 11:22
• Updated: 03/May/13 21:08

Description

my Hadoop-2.x runs are full of log warnings of the form

2013-04-19 12:20:15,642 [JobControl] WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(146)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.

Hadoop 2 has changed the property name used to disable these warnings -the new value is mapreduce.client.genericoptionsparser.used.

It should be set on Job submission to clean the logs up

Issue Links

• is related to: PIG-2407 Clean up warning messages for hadoop 23