Bigtop
  1. Bigtop
  2. BIGTOP-577

[base conf] There's no hadoop-metrics2.properties present in the configs that are shipped.

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.4.0
    • Fix Version/s: 0.4.0
    • Component/s: general
    • Labels:
      None

      Description

      The 0.23 and higher Hadoop versions make use of hadoop-metrics2.properties files. I don't see this being present in the pseudo-conf listing at least:

      [root@test ~]# ls -l /etc/hadoop/conf/
      total 40
      -rwxr-xr-x. 1 root root 1461 Apr 22 02:30 core-site.xml
      -rwxr-xr-x. 1 root root 1364 Apr 22 02:30 hadoop-env.sh
      -rwxr-xr-x. 1 root root 2890 Apr 22 02:30 hadoop-metrics.properties
      -rwxr-xr-x. 1 root root 1875 May  3 18:54 hdfs-site.xml
      -rwxr-xr-x. 1 root root 8511 Apr 30 14:41 log4j.properties
      -rwxr-xr-x. 1 root root 1325 Apr 22 02:30 mapred-site.xml
      -rwxr-xr-x. 1 root root 1104 Apr 22 02:30 README
      -rwxr-xr-x. 1 root root 2077 May  4 11:54 yarn-site.xml
      

      And hence it leads to logs in RM such as:

      2012-05-03 20:11:57,331 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-resourcemanager.properties,hadoop-metrics2.properties

      We have this file available in the sources of upstream Hadoop, but does not look like it gets packaged here:

      ./hadoop-common-project/hadoop-common/src/main/conf/hadoop-metrics2.properties
      ./hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-metrics2.properties
      ./hadoop-hdfs-project/hadoop-hdfs/src/main/conf/hadoop-metrics2.properties
      

      Adding since am unsure: If this is an upstream bug that this config file isn't included, please do move it to the HADOOP project.

      1. BIGTOP-577.patch.txt
        0.7 kB
        Roman Shaposhnik

        Activity

          People

          • Assignee:
            Roman Shaposhnik
            Reporter:
            Harsh J
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development