Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15620 Über-jira: S3A phase VI: Hadoop 3.3 features
  3. HADOOP-12949

Add HTrace to the s3a connector

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • fs/s3
    • None

    Description

      Hi All,

      s3, GCS, WASB, and other cloud blob stores are becoming increasingly important in Hadoop. But we don't have distributed tracing for these yet. It would be interesting to add distributed tracing here. It would enable collecting really interesting data like probability distributions of PUT and GET requests to s3 and their impact on MR jobs, etc.

      I would like to implement this feature, Please shed some light on this

      Thanks,
      Madhawa

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-15566 Support OpenTelemetry

          • Major - Major loss of function.
          • Patch Available
          relates to

          Sub-task - The sub-task of the issue HADOOP-13028 add low level counter metrics for S3A; use in read performance tests

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. GSOC-66 Add HTrace distributed tracing for s3 and other alternative Hadoop FS implementations

          • Major - Major loss of function.
          • Closed

          Activity

            People

              madhawa Madhawa Kasun Gunasekara
              Madhawa Gunasekara Madhawa Gunasekara
              Votes:
              1 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: