Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-3071

Expose splitKeyRanges in the C++ clients

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: n/a
    • Component/s: client, perf
    • Labels:
      None

      Description

      KUDU-2437 introduced the server-side ability to return "split keys" that logically divide a given tablet into key ranges. KUDU-2670 introduced an improvement in the Spark integration's KuduRDD to allow for Spark to use this generate smaller-scoped scan tokens that each scan a chunk of a tablet instead of entire tablets. This decoupled the a table's partitioning scheme from its read concurrency limitations.

      It'd be great if we could expose chunked-token-hydration in the C++ client so that Impala can begin generating these chunked tokens and then hydrating them into smaller scanners in its backend.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              awong Andrew Wong
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: