Bigtop
  1. Bigtop
  2. BIGTOP-577

[base conf] There's no hadoop-metrics2.properties present in the configs that are shipped.

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.4.0
    • Fix Version/s: 0.4.0
    • Component/s: General
    • Labels:
      None

      Description

      The 0.23 and higher Hadoop versions make use of hadoop-metrics2.properties files. I don't see this being present in the pseudo-conf listing at least:

      [root@test ~]# ls -l /etc/hadoop/conf/
      total 40
      -rwxr-xr-x. 1 root root 1461 Apr 22 02:30 core-site.xml
      -rwxr-xr-x. 1 root root 1364 Apr 22 02:30 hadoop-env.sh
      -rwxr-xr-x. 1 root root 2890 Apr 22 02:30 hadoop-metrics.properties
      -rwxr-xr-x. 1 root root 1875 May  3 18:54 hdfs-site.xml
      -rwxr-xr-x. 1 root root 8511 Apr 30 14:41 log4j.properties
      -rwxr-xr-x. 1 root root 1325 Apr 22 02:30 mapred-site.xml
      -rwxr-xr-x. 1 root root 1104 Apr 22 02:30 README
      -rwxr-xr-x. 1 root root 2077 May  4 11:54 yarn-site.xml
      

      And hence it leads to logs in RM such as:

      2012-05-03 20:11:57,331 WARN org.apache.hadoop.metrics2.impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-resourcemanager.properties,hadoop-metrics2.properties

      We have this file available in the sources of upstream Hadoop, but does not look like it gets packaged here:

      ./hadoop-common-project/hadoop-common/src/main/conf/hadoop-metrics2.properties
      ./hadoop-common-project/hadoop-common/src/main/packages/templates/conf/hadoop-metrics2.properties
      ./hadoop-hdfs-project/hadoop-hdfs/src/main/conf/hadoop-metrics2.properties
      

      Adding since am unsure: If this is an upstream bug that this config file isn't included, please do move it to the HADOOP project.

      1. BIGTOP-577.patch.txt
        0.7 kB
        Roman Shaposhnik

        Activity

        Harsh J created issue -
        Roman Shaposhnik made changes -
        Field Original Value New Value
        Attachment BIGTOP-577.patch.txt [ 12525642 ]
        Roman Shaposhnik made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Affects Version/s 0.4.0 [ 12318889 ]
        Assignee Roman Shaposhnik [ rvs ]
        Fix Version/s 0.4.0 [ 12318889 ]
        Roman Shaposhnik made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Gavin made changes -
        Workflow no-reopen-closed, patch-avail [ 12665424 ] patch-available, re-open possible [ 12666142 ]
        Roman Shaposhnik made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Roman Shaposhnik
            Reporter:
            Harsh J
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development