Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14831 Über-jira: S3a phase IV: Hadoop 3.1 features
  3. HADOOP-14475

Metrics of S3A don't print out when enable it in Hadoop metrics property file

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 3.1.0
    • Component/s: fs/s3
    • Labels:
      None
    • Environment:

      uname -a
      Linux client01 4.4.0-74-generic #95-Ubuntu SMP Wed Apr 12 09:50:34 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

      cat /etc/issue
      Ubuntu 16.04.2 LTS \n \l

    • Target Version/s:

      Description

      *.sink.file.class=org.apache.hadoop.metrics2.sink.FileSink
      #*.sink.file.class=org.apache.hadoop.metrics2.sink.influxdb.InfluxdbSink
      #*.sink.influxdb.url=http:/xxxxxxxxxx
      #*.sink.influxdb.influxdb_port=8086
      #*.sink.influxdb.database=hadoop
      #*.sink.influxdb.influxdb_username=hadoop
      #*.sink.influxdb.influxdb_password=hadoop
      #*.sink.ingluxdb.cluster=c1

      *.period=10
      #namenode.sink.influxdb.class=org.apache.hadoop.metrics2.sink.influxdb.InfluxdbSink
      #S3AFileSystem.sink.influxdb.class=org.apache.hadoop.metrics2.sink.influxdb.InfluxdbSink
      S3AFileSystem.sink.file.filename=s3afilesystem-metrics.out

      I can't find the out put file even i run a MR job which should be used s3.

        Attachments

        1. HADOOP-14475.017.patch
          13 kB
          Sean Mackrory
        2. HADOOP-14475.016.patch
          13 kB
          Sean Mackrory
        3. HADOOP-14475.015.patch
          13 kB
          Sean Mackrory
        4. HADOOP-14475.014.patch
          13 kB
          Sean Mackrory
        5. HADOOP-14475.013.patch
          11 kB
          Sean Mackrory
        6. HADOOP-14475.012.patch
          8 kB
          Sean Mackrory
        7. HADOOP-14475.011.patch
          7 kB
          Sean Mackrory
        8. HADOOP-14475.010.patch
          8 kB
          Sean Mackrory
        9. HADOOP-14475.009.patch
          8 kB
          Sean Mackrory
        10. HADOOP-14475.008.patch
          7 kB
          Yonger
        11. HADOOP-14775.007.patch
          7 kB
          Yonger
        12. HADOOP-14475.006.patch
          9 kB
          Yonger
        13. HADOOP-14475.005.patch
          8 kB
          Yonger
        14. HADOOP-14475-003.patch
          5 kB
          Yonger
        15. failsafe-report-scale.zip
          6.74 MB
          Yonger
        16. failsafe-report-scale.html
          287 kB
          Yonger
        17. failsafe-report-s3a-it.html
          153 kB
          Yonger
        18. failsafe-report-s3a-scale.html
          166 kB
          Yonger
        19. HADOOP-14475.002.patch
          6 kB
          Yonger
        20. stdout.zip
          2.33 MB
          Yonger
        21. s3a-metrics.patch1
          8 kB
          Yonger

          Issue Links

            Activity

              People

              • Assignee:
                iyonger Yonger
                Reporter:
                iyonger Yonger
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: