Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-12411

Optionally enable p-reads and private readers for compactions

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.98.9, 0.99.2
    • Component/s: Performance
    • Labels:
      None
    • Release Note:
      Hide
      This introduces two new configuration options:
      # hbase.storescanner.use.pread enables postional reads for all scanners (except compactions). Default off (i.e. try to use seek+read as before)
      # hbase.regionserver.compaction.private.readers has compaction run with their own readers. Default off (i.e. share readers with all other scanners as before)
      Show
      This introduces two new configuration options: # hbase.storescanner.use.pread enables postional reads for all scanners (except compactions). Default off (i.e. try to use seek+read as before) # hbase.regionserver.compaction.private.readers has compaction run with their own readers. Default off (i.e. share readers with all other scanners as before)

      Description

      In the light of HDFS-6735 we might want to consider refraining from seek + read completely and only perform preads.

      For example currently a compaction can lock out every other scanner over the file which the compaction is currently reading for compaction.

      At the very least we can introduce an option to avoid seek + read, so we can allow testing this in various scenarios.
      This will definitely be of great importance for projects like Phoenix which parallelize queries intra region (and hence readers will used concurrently by multiple scanner with high likelihood.)

        Attachments

        1. HBASE-12411-0.94.txt
          5 kB
          Liang Xie
        2. 12411-v4.txt
          5 kB
          Lars Hofhansl
        3. 12411-v3.txt
          5 kB
          Lars Hofhansl
        4. 12411-v2.txt
          3 kB
          Lars Hofhansl
        5. 12411.txt
          2 kB
          Lars Hofhansl

          Activity

            People

            • Assignee:
              larsh Lars Hofhansl
              Reporter:
              larsh Lars Hofhansl
            • Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: