Uploaded image for project: 'Bigtop'
  1. Bigtop
  2. BIGTOP-577

[base conf] There's no hadoop-metrics2.properties present in the configs that are shipped.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.4.0
    • 0.4.0
    • general
    • None

    Description

      The 0.23 and higher Hadoop versions make use of hadoop-metrics2.properties files. I don't see this being present in the pseudo-conf listing at least:

      [root@test ~]# ls -l /etc/hadoop/conf/
      total 40
      -rwxr-xr-x. 1 root root 1461 Apr 22 02:30 core-site.xml
      -rwxr-xr-x. 1 root root 1364 Apr 22 02:30 hadoop-env.sh
      -rwxr-xr-x. 1 root root 2890 Apr 22 02:30 hadoop-metrics.properties
      -rwxr-xr-x. 1 root root 1875 May  3 18:54 hdfs-site.xml
      -rwxr-xr-x. 1 root root 8511 Apr 30 14:41 log4j.properties
      -rwxr-xr-x. 1 root root 1325 Apr 22 02:30 mapred-site.xml
      -rwxr-xr-x. 1 root root 1104 Apr 22 02:30 README
      -rwxr-xr-x. 1 root root 2077 May  4 11:54 yarn-site.xml
      

      And hence it leads to logs in RM such as:

      2012-05-03 20:11:57,331 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-resourcemanager.properties,hadoop-metrics2.properties

      We have this file available in the sources of upstream Hadoop, but does not look like it gets packaged here:

      ./hadoop-common-project/hadoop-common/src/main/conf/hadoop-metrics2.properties
      ./hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-metrics2.properties
      ./hadoop-hdfs-project/hadoop-hdfs/src/main/conf/hadoop-metrics2.properties
      

      Adding since am unsure: If this is an upstream bug that this config file isn't included, please do move it to the HADOOP project.

      Attachments

        1. BIGTOP-577.patch.txt
          0.7 kB
          Roman Shaposhnik

        Activity

          People

            rvs Roman Shaposhnik
            qwertymaniac Harsh J
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: