Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5274

Add Tracing to HDFS

          Details

          • Type: New Feature
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 2.1.1-beta
          • Fix Version/s: None
          • Component/s: datanode, namenode
          • Labels:

            Description

            Since Google's Dapper paper has shown the benefits of tracing for a large distributed system, it seems like a good time to add tracing to HDFS. HBase has added tracing using HTrace. I propose that the same can be done within HDFS.

              Attachments

              1. HDFS-5274-17.patch
                86 kB
                Masatake Iwasaki
              2. HDFS-5274-16.patch
                83 kB
                Masatake Iwasaki
              3. HDFS-5274-15.patch
                84 kB
                Masatake Iwasaki
              4. HDFS-5274-14.patch
                84 kB
                Masatake Iwasaki
              5. 3node_put_200mb.png
                240 kB
                Masatake Iwasaki
              6. 3node_get_200mb.png
                117 kB
                Masatake Iwasaki
              7. 3node_put_200mb.png
                238 kB
                Masatake Iwasaki
              8. HDFS-5274-13.patch
                77 kB
                Masatake Iwasaki
              9. HDFS-5274-12.patch
                76 kB
                Masatake Iwasaki
              10. HDFS-5274-11.txt
                76 kB
                stack
              11. HDFS-5274-10.patch
                75 kB
                stack
              12. HDFS-5274-9.patch
                76 kB
                Masatake Iwasaki
              13. HDFS-5274-8.patch
                76 kB
                Masatake Iwasaki
              14. ss-5274v8-get.png
                85 kB
                Masatake Iwasaki
              15. ss-5274v8-put.png
                162 kB
                Masatake Iwasaki
              16. HDFS-5274-8.patch
                76 kB
                Masatake Iwasaki
              17. HDFS-5274-7.patch
                78 kB
                Masatake Iwasaki
              18. HDFS-5274-6.patch
                97 kB
                Elliott Clark
              19. HDFS-5274-5.patch
                92 kB
                Elliott Clark
              20. Zipkin Trace d0f0d66b8a258a69.png
                211 kB
                Elliott Clark
              21. HDFS-5274-4.patch
                91 kB
                Elliott Clark
              22. HDFS-5274-3.patch
                74 kB
                Elliott Clark
              23. HDFS-5274-2.patch
                74 kB
                Elliott Clark
              24. Zipkin Trace a06e941b0172ec73.png
                167 kB
                Elliott Clark
              25. HDFS-5274-1.patch
                59 kB
                Elliott Clark
              26. HDFS-5274-0.patch
                52 kB
                Elliott Clark

                Issue Links

                is depended upon by

                Improvement - An improvement or enhancement to an existing feature or task. ACCUMULO-1197 Pass Accumulo trace functionality through the DFSClient

                • Major - Major loss of function.
                • Resolved
                is related to

                New Feature - A new feature of the product, which has yet to be developed. HBASE-6449 Dapper like tracing

                • Major - Major loss of function.
                • Resolved
                relates to

                Bug - A problem which impairs or prevents the functions of the product. HDFS-7001 Tests in TestTracing should not depend on the order of execution

                • Minor - Minor loss of function, or other problem where easy workaround is present.
                • Closed
                There are no Sub-Tasks for this issue.

                  Activity

                    People

                    • Assignee:
                      eclark Elliott Clark
                      Reporter:
                      eclark Elliott Clark
                    • Votes:
                      1 Vote for this issue
                      Watchers:
                      44 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: