Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15566

Support OpenTelemetry

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersStop watchingWatchersCreate sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      The HTrace incubator project has voted to retire itself and won't be making further releases. The Hadoop project currently has various hooks with HTrace. It seems in some cases (eg HDFS-13702) these hooks have had measurable performance overhead. Given these two factors, I think we should consider removing the HTrace integration. If there is someone willing to do the work, replacing it with OpenTracing might be a better choice since there is an active community.

      Attachments

        1. HADOOP-15566-WIP.1.patch
          15 kB
          Kiran Kumar Maturi
        2. OpenTelemetry Support Scope Doc v2.pdf
          49 kB
          Siyao Meng
        3. OpenTracing Support Scope Doc.pdf
          49 kB
          Wei-Chiu Chuang
        4. HADOOP-15566.000.WIP.patch
          78 kB
          Siyao Meng
        5. ss-trace-s3a.png
          191 kB
          Aaron Fabbri
        6. Screen Shot 2018-06-29 at 11.59.16 AM.png
          215 kB
          Wei-Chiu Chuang

        Issue Links

        is duplicated by

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-17171 Please fix CVEs by removing reference to htrace-core4

        • Major - Major loss of function.
        • Resolved
        is related to

        Bug - A problem which impairs or prevents the functions of the product. HDDS-1153 Make tracing instrumentation configurable

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HDFS-13702 Remove HTrace hooks from DFSClient to reduce CPU usage

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. HBASE-22120 Replace HTrace with OpenTelemetry

        • Major - Major loss of function.
        • Resolved

        Task - A task that needs to be done. HADOOP-16867 [thirdparty] Add shaded JaegerTracer

        • Major - Major loss of function.
        • Resolved
        relates to

        Sub-task - The sub-task of the issue HADOOP-16394 Support OpenTracing in DistCp

        • Major - Major loss of function.
        • Open

        Sub-task - The sub-task of the issue HDFS-14607 Support OpenTracing in WebHDFS

        • Major - Major loss of function.
        • In Progress

        Sub-task - The sub-task of the issue HADOOP-12949 Add HTrace to the s3a connector

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. PHOENIX-5215 Remove and replace HTrace

        • Major - Major loss of function.
        • Patch Available

        New Feature - A new feature of the product, which has yet to be developed. HDFS-14606 Support OpenTracing in HDFS

        • Major - Major loss of function.
        • Open

        New Feature - A new feature of the product, which has yet to be developed. YARN-10956 Add OpenTelemetry instrumentation code into YARN

        • Major - Major loss of function.
        • Open

        New Feature - A new feature of the product, which has yet to be developed. HADOOP-15407 Support Windows Azure Storage - Blob file system in Hadoop

        • Blocker - Blocks development and/or testing work, production could not run
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. HDFS-5274 Add Tracing to HDFS

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. SOLR-13434 OpenTracing support for Solr

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. HIVE-19685 OpenTracing support for HMS

        • Major - Major loss of function.
        • Patch Available
        links to

        Web Link GitHub Pull Request #1846

        Web Link GitHub Pull Request #2816

        Web Link GitHub Pull Request #3445

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            smeng Siyao Meng Assign to me
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            70 Stop watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

              Estimated:
              Original Estimate - Not Specified
              Not Specified
              Remaining:
              Remaining Estimate - 0h
              0h
              Logged:
              Time Spent - 22h 10m
              22h 10m

              Slack

                Issue deployment