Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14300

GraphiteSink reports metrics containing undesirable whitespaces

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Trivial
    • Resolution: Unresolved
    • 2.5.0, 2.6.0, 2.7.0, 2.7.1, 2.7.2, 2.7.3
    • None
    • metrics
    • None

    Description

      According to the Graphite documentation, the data sent must be in the following format: <metric path> <metric value> <metric timestamp>

      But some tag values that are flattened in the metricpath string sometimes include whitespaces and violate the carbon/graphite format.

      For example, the dirpath enumeration from the datanode :
      FSDatasetState.org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.Context=FSDatasetState.StorageInfo=FSDataset

      {dirpath='[/data/1/hdfs/data/current, /data/2/hdfs/data/current]'}

      .Hostname=worker1.Capacity 78436466688 1491986609

      Currently, none of the aggregators available in the Graphite ecosystem can handle these malformed metrics. These whitespaces should be replaced by underscores.

      I will be happy to attach a small patch.

      Attachments

        1. HADOOP-14300
          1 kB
          Damien Claveau
        2. HADOOP-14300.001.patch
          9 kB
          Damien Claveau

        Issue Links

          Activity

            People

              damien.claveau Damien Claveau
              damien.claveau Damien Claveau
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: