Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-7868

HFile performance regression between 0.92 and 0.94

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.94.5
    • Fix Version/s: None
    • Component/s: io
    • Labels:
      None

      Description

      By HFilePerformanceEvaluation seems that 0.94 is slower then 0.92

      Looking at the profiler for the Scan path, seems that most of the time, compared to 92, is spent in the metrics dictionary lookup. Elliott Clark pointed out the new per family/block metrics.

      By commenting the metrics call in HFileReaderV2, the performance seems to get better, but maybe metrics is not the only problem.

        Attachments

        1. hfileperf-graphs.png
          58 kB
          Matteo Bertozzi
        2. FilteredScan.png
          24 kB
          Jean-Marc Spaggiari
        3. performances.pdf
          16 kB
          Jean-Marc Spaggiari
        4. performances.pdf
          22 kB
          Jean-Marc Spaggiari
        5. HFilePerformanceEvaluation.txt
          56 kB
          Jean-Marc Spaggiari

          Activity

            People

            • Assignee:
              mbertozzi Matteo Bertozzi
              Reporter:
              mbertozzi Matteo Bertozzi
            • Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: