Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.94.3, 0.95.2
    • Fix Version/s: 0.95.0
    • Component/s: Performance, Scanners
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      This JIRA adds the ability of doing parallel seek in StoreScanner. It is off by default.
      The following config parameter turns on this feature:
      hbase.storescanner.parallel.seek.enable

      hbase.storescanner.parallel.seek.threads controls the number of threads in thread pool which serves parallel seeking. Default is 10 threads.
      Show
      This JIRA adds the ability of doing parallel seek in StoreScanner. It is off by default. The following config parameter turns on this feature: hbase.storescanner.parallel.seek.enable hbase.storescanner.parallel.seek.threads controls the number of threads in thread pool which serves parallel seeking. Default is 10 threads.

      Description

      seems there's a potential improvable space before doing scanner.next:

      StoreScanner.java
          if (explicitColumnQuery && lazySeekEnabledGlobally) {
            for (KeyValueScanner scanner : scanners) {
              scanner.requestSeek(matcher.getStartKey(), false, true);
            }
          } else {
            for (KeyValueScanner scanner : scanners) {
              scanner.seek(matcher.getStartKey());
            }
          }
      

      we can do scanner.requestSeek or scanner.seek in parallel, instead of current serialization, to reduce latency for special case.

      Any ideas on it ? I'll have a try if the comments/suggestions are positive:)

      1. 7495-v12.txt
        22 kB
        Ted Yu
      2. HBASE-7495-v11.txt
        24 kB
        Liang Xie
      3. HBASE-7495-0.94.txt
        14 kB
        Liang Xie
      4. HBASE-7495-v10.txt
        19 kB
        Liang Xie
      5. HBASE-7495-v9.txt
        17 kB
        Liang Xie
      6. HBASE-7495-v8.txt
        16 kB
        Liang Xie
      7. HBASE-7495-v7.txt
        10 kB
        Liang Xie
      8. HBASE-7495-v6.txt
        10 kB
        Liang Xie
      9. HBASE-7495-v5.txt
        8 kB
        Liang Xie
      10. HBASE-7495-v4.txt
        4 kB
        Liang Xie
      11. HBASE-7495-v4.txt
        4 kB
        Liang Xie
      12. HBASE-7495-v3.txt
        4 kB
        Liang Xie
      13. HBASE-7495-v2.txt
        5 kB
        Liang Xie
      14. HBASE-7495.txt
        4 kB
        Liang Xie
      15. HBASE-7495.txt
        4 kB
        Liang Xie
      16. HBASE-7495.txt
        2 kB
        Liang Xie

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Liang Xie
            Reporter:
            Liang Xie
          • Votes:
            0 Vote for this issue
            Watchers:
            16 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development