Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3283

job launcher should set mapreduce.client.genericoptionsparser.used property to suppress warning messages

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 0.11.1
    • None
    • None
    • None

    Description

      my Hadoop-2.x runs are full of log warnings of the form

      2013-04-19 12:20:15,642 [JobControl] WARN  mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(146)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
      

      Hadoop 2 has changed the property name used to disable these warnings -the new value is mapreduce.client.genericoptionsparser.used.

      It should be set on Job submission to clean the logs up

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            stevel@apache.org Steve Loughran

            Dates

              Created:
              Updated:

              Slack

                Issue deployment