Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.94.3, 0.95.2
    • Fix Version/s: 0.95.0
    • Component/s: Performance, Scanners
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      This JIRA adds the ability of doing parallel seek in StoreScanner. It is off by default.
      The following config parameter turns on this feature:
      hbase.storescanner.parallel.seek.enable

      hbase.storescanner.parallel.seek.threads controls the number of threads in thread pool which serves parallel seeking. Default is 10 threads.
      Show
      This JIRA adds the ability of doing parallel seek in StoreScanner. It is off by default. The following config parameter turns on this feature: hbase.storescanner.parallel.seek.enable hbase.storescanner.parallel.seek.threads controls the number of threads in thread pool which serves parallel seeking. Default is 10 threads.

      Description

      seems there's a potential improvable space before doing scanner.next:

      StoreScanner.java
          if (explicitColumnQuery && lazySeekEnabledGlobally) {
            for (KeyValueScanner scanner : scanners) {
              scanner.requestSeek(matcher.getStartKey(), false, true);
            }
          } else {
            for (KeyValueScanner scanner : scanners) {
              scanner.seek(matcher.getStartKey());
            }
          }
      

      we can do scanner.requestSeek or scanner.seek in parallel, instead of current serialization, to reduce latency for special case.

      Any ideas on it ? I'll have a try if the comments/suggestions are positive:)

      1. HBASE-7495-v9.txt
        17 kB
        Liang Xie
      2. HBASE-7495-v8.txt
        16 kB
        Liang Xie
      3. HBASE-7495-v7.txt
        10 kB
        Liang Xie
      4. HBASE-7495-v6.txt
        10 kB
        Liang Xie
      5. HBASE-7495-v5.txt
        8 kB
        Liang Xie
      6. HBASE-7495-v4.txt
        4 kB
        Liang Xie
      7. HBASE-7495-v4.txt
        4 kB
        Liang Xie
      8. HBASE-7495-v3.txt
        4 kB
        Liang Xie
      9. HBASE-7495-v2.txt
        5 kB
        Liang Xie
      10. HBASE-7495-v11.txt
        24 kB
        Liang Xie
      11. HBASE-7495-v10.txt
        19 kB
        Liang Xie
      12. HBASE-7495-0.94.txt
        14 kB
        Liang Xie
      13. HBASE-7495.txt
        2 kB
        Liang Xie
      14. HBASE-7495.txt
        4 kB
        Liang Xie
      15. HBASE-7495.txt
        4 kB
        Liang Xie
      16. 7495-v12.txt
        22 kB
        Ted Yu

        Activity

          People

          • Assignee:
            Liang Xie
            Reporter:
            Liang Xie
          • Votes:
            0 Vote for this issue
            Watchers:
            16 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development