Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.94.3, 0.95.2
    • Fix Version/s: 0.95.0
    • Component/s: Performance, Scanners
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      This JIRA adds the ability of doing parallel seek in StoreScanner. It is off by default.
      The following config parameter turns on this feature:
      hbase.storescanner.parallel.seek.enable

      hbase.storescanner.parallel.seek.threads controls the number of threads in thread pool which serves parallel seeking. Default is 10 threads.
      Show
      This JIRA adds the ability of doing parallel seek in StoreScanner. It is off by default. The following config parameter turns on this feature: hbase.storescanner.parallel.seek.enable hbase.storescanner.parallel.seek.threads controls the number of threads in thread pool which serves parallel seeking. Default is 10 threads.

      Description

      seems there's a potential improvable space before doing scanner.next:

      StoreScanner.java
          if (explicitColumnQuery && lazySeekEnabledGlobally) {
            for (KeyValueScanner scanner : scanners) {
              scanner.requestSeek(matcher.getStartKey(), false, true);
            }
          } else {
            for (KeyValueScanner scanner : scanners) {
              scanner.seek(matcher.getStartKey());
            }
          }
      

      we can do scanner.requestSeek or scanner.seek in parallel, instead of current serialization, to reduce latency for special case.

      Any ideas on it ? I'll have a try if the comments/suggestions are positive:)

        Attachments

        1. HBASE-7495.txt
          2 kB
          Liang Xie
        2. HBASE-7495.txt
          4 kB
          Liang Xie
        3. HBASE-7495.txt
          4 kB
          Liang Xie
        4. HBASE-7495-v2.txt
          5 kB
          Liang Xie
        5. HBASE-7495-v3.txt
          4 kB
          Liang Xie
        6. HBASE-7495-v4.txt
          4 kB
          Liang Xie
        7. HBASE-7495-v4.txt
          4 kB
          Liang Xie
        8. HBASE-7495-v5.txt
          8 kB
          Liang Xie
        9. HBASE-7495-v6.txt
          10 kB
          Liang Xie
        10. HBASE-7495-v7.txt
          10 kB
          Liang Xie
        11. HBASE-7495-v8.txt
          16 kB
          Liang Xie
        12. HBASE-7495-v9.txt
          17 kB
          Liang Xie
        13. HBASE-7495-v10.txt
          19 kB
          Liang Xie
        14. HBASE-7495-0.94.txt
          14 kB
          Liang Xie
        15. HBASE-7495-v11.txt
          24 kB
          Liang Xie
        16. 7495-v12.txt
          22 kB
          Ted Yu

          Activity

            People

            • Assignee:
              xieliang007 Liang Xie
              Reporter:
              xieliang007 Liang Xie
            • Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: