Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8088

Reduce the number of HTrace spans generated by HDFS reads

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • None
    • None

    Description

      HDFS generates too many trace spans on read right now. Every call to read() we make generates its own span, which is not very practical for things like HBase or Accumulo that do many such reads as part of a single operation. Instead of tracing every call to read(), we should only trace the cases where we refill the buffer inside a BlockReader.

      Attachments

        1. HDFS-8088.001.patch
          11 kB
          Colin McCabe

        Issue Links

          Activity

            People

              cmccabe Colin McCabe
              cmccabe Colin McCabe
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: