Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-577

[base conf] There's no hadoop-metrics2.properties present in the configs that are shipped.

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.4.0
    • Fix Version/s: 0.4.0
    • Component/s: general
    • Labels:
      None

      Description

      The 0.23 and higher Hadoop versions make use of hadoop-metrics2.properties files. I don't see this being present in the pseudo-conf listing at least:

      [root@test ~]# ls -l /etc/hadoop/conf/
      total 40
      -rwxr-xr-x. 1 root root 1461 Apr 22 02:30 core-site.xml
      -rwxr-xr-x. 1 root root 1364 Apr 22 02:30 hadoop-env.sh
      -rwxr-xr-x. 1 root root 2890 Apr 22 02:30 hadoop-metrics.properties
      -rwxr-xr-x. 1 root root 1875 May  3 18:54 hdfs-site.xml
      -rwxr-xr-x. 1 root root 8511 Apr 30 14:41 log4j.properties
      -rwxr-xr-x. 1 root root 1325 Apr 22 02:30 mapred-site.xml
      -rwxr-xr-x. 1 root root 1104 Apr 22 02:30 README
      -rwxr-xr-x. 1 root root 2077 May  4 11:54 yarn-site.xml
      

      And hence it leads to logs in RM such as:

      2012-05-03 20:11:57,331 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-resourcemanager.properties,hadoop-metrics2.properties

      We have this file available in the sources of upstream Hadoop, but does not look like it gets packaged here:

      ./hadoop-common-project/hadoop-common/src/main/conf/hadoop-metrics2.properties
      ./hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-metrics2.properties
      ./hadoop-hdfs-project/hadoop-hdfs/src/main/conf/hadoop-metrics2.properties
      

      Adding since am unsure: If this is an upstream bug that this config file isn't included, please do move it to the HADOOP project.

        Attachments

        1. BIGTOP-577.patch.txt
          0.7 kB
          Roman Shaposhnik

          Activity

            People

            • Assignee:
              rvs Roman Shaposhnik
              Reporter:
              qwertymaniac Harsh J
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: