Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14831 Über-jira: S3a phase IV: Hadoop 3.1 features
  3. HADOOP-14475

Metrics of S3A don't print out when enable it in Hadoop metrics property file

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.8.0
    • 3.1.0
    • fs/s3
    • None
    • uname -a
      Linux client01 4.4.0-74-generic #95-Ubuntu SMP Wed Apr 12 09:50:34 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

      cat /etc/issue
      Ubuntu 16.04.2 LTS \n \l

    Description

      *.sink.file.class=org.apache.hadoop.metrics2.sink.FileSink
      #*.sink.file.class=org.apache.hadoop.metrics2.sink.influxdb.InfluxdbSink
      #*.sink.influxdb.url=http:/xxxxxxxxxx
      #*.sink.influxdb.influxdb_port=8086
      #*.sink.influxdb.database=hadoop
      #*.sink.influxdb.influxdb_username=hadoop
      #*.sink.influxdb.influxdb_password=hadoop
      #*.sink.ingluxdb.cluster=c1

      *.period=10
      #namenode.sink.influxdb.class=org.apache.hadoop.metrics2.sink.influxdb.InfluxdbSink
      #S3AFileSystem.sink.influxdb.class=org.apache.hadoop.metrics2.sink.influxdb.InfluxdbSink
      S3AFileSystem.sink.file.filename=s3afilesystem-metrics.out

      I can't find the out put file even i run a MR job which should be used s3.

      Attachments

        1. stdout.zip
          2.33 MB
          Yonger
        2. s3a-metrics.patch1
          8 kB
          Yonger
        3. HADOOP-14775.007.patch
          7 kB
          Yonger
        4. HADOOP-14475-003.patch
          5 kB
          Yonger
        5. HADOOP-14475.017.patch
          13 kB
          Sean Mackrory
        6. HADOOP-14475.016.patch
          13 kB
          Sean Mackrory
        7. HADOOP-14475.015.patch
          13 kB
          Sean Mackrory
        8. HADOOP-14475.014.patch
          13 kB
          Sean Mackrory
        9. HADOOP-14475.013.patch
          11 kB
          Sean Mackrory
        10. HADOOP-14475.012.patch
          8 kB
          Sean Mackrory
        11. HADOOP-14475.011.patch
          7 kB
          Sean Mackrory
        12. HADOOP-14475.010.patch
          8 kB
          Sean Mackrory
        13. HADOOP-14475.009.patch
          8 kB
          Sean Mackrory
        14. HADOOP-14475.008.patch
          7 kB
          Yonger
        15. HADOOP-14475.006.patch
          9 kB
          Yonger
        16. HADOOP-14475.005.patch
          8 kB
          Yonger
        17. HADOOP-14475.002.patch
          6 kB
          Yonger
        18. failsafe-report-scale.zip
          6.74 MB
          Yonger
        19. failsafe-report-scale.html
          287 kB
          Yonger
        20. failsafe-report-s3a-scale.html
          166 kB
          Yonger
        21. failsafe-report-s3a-it.html
          153 kB
          Yonger

        Issue Links

          Activity

            People

              iyonger Yonger
              iyonger Yonger
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: