Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15566

Support OpenTelemetry

    XMLWordPrintableJSON

Details

    Description

      The HTrace incubator project has voted to retire itself and won't be making further releases. The Hadoop project currently has various hooks with HTrace. It seems in some cases (eg HDFS-13702) these hooks have had measurable performance overhead. Given these two factors, I think we should consider removing the HTrace integration. If there is someone willing to do the work, replacing it with OpenTracing might be a better choice since there is an active community.

      Attachments

        1. Screen Shot 2018-06-29 at 11.59.16 AM.png
          215 kB
          Wei-Chiu Chuang
        2. ss-trace-s3a.png
          191 kB
          Aaron Fabbri
        3. HADOOP-15566.000.WIP.patch
          78 kB
          Siyao Meng
        4. OpenTracing Support Scope Doc.pdf
          49 kB
          Wei-Chiu Chuang
        5. OpenTelemetry Support Scope Doc v2.pdf
          49 kB
          Siyao Meng
        6. HADOOP-15566-WIP.1.patch
          15 kB
          Kiran Kumar Maturi

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-17171 Please fix CVEs by removing reference to htrace-core4

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDDS-1153 Make tracing instrumentation configurable

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-13702 Remove HTrace hooks from DFSClient to reduce CPU usage

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HBASE-22120 Replace HTrace with OpenTelemetry

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. HADOOP-16867 [thirdparty] Add shaded JaegerTracer

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HADOOP-16394 Support OpenTracing in DistCp

          • Major - Major loss of function.
          • Open

          Sub-task - The sub-task of the issue HDFS-14607 Support OpenTracing in WebHDFS

          • Major - Major loss of function.
          • In Progress

          Sub-task - The sub-task of the issue HADOOP-12949 Add HTrace to the s3a connector

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. PHOENIX-5215 Remove and replace HTrace

          • Major - Major loss of function.
          • Patch Available

          New Feature - A new feature of the product, which has yet to be developed. HDFS-14606 Support OpenTracing in HDFS

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. YARN-10956 Add OpenTelemetry instrumentation code into YARN

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-15407 Support Windows Azure Storage - Blob file system in Hadoop

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HDFS-5274 Add Tracing to HDFS

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. SOLR-13434 OpenTracing support for Solr

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. HIVE-19685 OpenTracing support for HMS

          • Major - Major loss of function.
          • Patch Available
          links to

          Web Link GitHub Pull Request #1846

          Web Link GitHub Pull Request #2816

          Web Link GitHub Pull Request #3445

          Activity

            People

              smeng Siyao Meng
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              71 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 22h 10m
                  22h 10m