Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-7679

log4j.properties templates does not define mapred.jobsummary.logger

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.205.0
    • Fix Version/s: 0.20.205.0
    • Component/s: conf
    • Labels:
      None

      Description

      In templates/conf/hadoop-env.sh, HADOOP_JOBTRACKER_OPTS is defined as -Dsecurity.audit.logger=INFO,DRFAS -Dmapred.audit.logger=INFO,MRAUDIT -Dmapred.jobsummary.logger=INFO,JSA $

      {HADOOP_JOBTRACKER_OPTS}

      However, in templates/conf/hadoop-env.sh, instead of mapred.jobsummary.logger, hadoop.mapreduce.jobsummary.logger is defined as follows:
      hadoop.mapreduce.jobsummary.logger=$

      {hadoop.root.logger}

      This is preventing collection of jobsummary logs.

      We have to consistently use mapred.jobsummary.logger in the templates.

      1. HADOOP-7679v2.txt
        1.0 kB
        Ramya Sunil
      2. HADOOP-7679.txt
        1 kB
        Ramya Sunil

        Activity

        Hide
        rramya Ramya Sunil added a comment -

        Patch for 205. Tested it and works fine.

        Show
        rramya Ramya Sunil added a comment - Patch for 205. Tested it and works fine.
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12496306/HADOOP-7679.txt
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/228//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12496306/HADOOP-7679.txt against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/228//console This message is automatically generated.
        Hide
        eyang Eric Yang added a comment -

        Can we make change in src/package/template/conf/hadoop-env.sh instead of log4j.properties? Thanks

        Show
        eyang Eric Yang added a comment - Can we make change in src/package/template/conf/hadoop-env.sh instead of log4j.properties? Thanks
        Hide
        rramya Ramya Sunil added a comment -

        Attaching a new patch addressing Eric's comments. The changes are now made to hadoop-env.sh

        Show
        rramya Ramya Sunil added a comment - Attaching a new patch addressing Eric's comments. The changes are now made to hadoop-env.sh
        Hide
        hadoopqa Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12496316/HADOOP-7679v2.txt
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        -1 patch. The patch command could not apply the patch.

        Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/229//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12496316/HADOOP-7679v2.txt against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 patch. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/229//console This message is automatically generated.
        Hide
        mattf Matt Foley added a comment -

        +1 code review.
        Committed to 0.20-security and 0.20.205.
        Thanks, Ramya!

        Show
        mattf Matt Foley added a comment - +1 code review. Committed to 0.20-security and 0.20.205. Thanks, Ramya!
        Hide
        mattf Matt Foley added a comment -

        Closed upon release of 0.20.205.0

        Show
        mattf Matt Foley added a comment - Closed upon release of 0.20.205.0

          People

          • Assignee:
            rramya Ramya Sunil
            Reporter:
            rramya Ramya Sunil
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development