Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-7868

HFile performance regression between 0.92 and 0.94

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 0.94.5
    • None
    • io
    • None

    Description

      By HFilePerformanceEvaluation seems that 0.94 is slower then 0.92

      Looking at the profiler for the Scan path, seems that most of the time, compared to 92, is spent in the metrics dictionary lookup. eclark pointed out the new per family/block metrics.

      By commenting the metrics call in HFileReaderV2, the performance seems to get better, but maybe metrics is not the only problem.

      Attachments

        1. hfileperf-graphs.png
          58 kB
          Matteo Bertozzi
        2. FilteredScan.png
          24 kB
          Jean-Marc Spaggiari
        3. performances.pdf
          16 kB
          Jean-Marc Spaggiari
        4. performances.pdf
          22 kB
          Jean-Marc Spaggiari
        5. HFilePerformanceEvaluation.txt
          56 kB
          Jean-Marc Spaggiari

        Activity

          People

            Unassigned Unassigned
            mbertozzi Matteo Bertozzi
            Votes:
            0 Vote for this issue
            Watchers:
            16 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: