Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-3071

Expose splitKeyRanges in the C++ clients

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • n/a
    • client, perf
    • None

    Description

      KUDU-2437 introduced the server-side ability to return "split keys" that logically divide a given tablet into key ranges. KUDU-2670 introduced an improvement in the Spark integration's KuduRDD to allow for Spark to use this generate smaller-scoped scan tokens that each scan a chunk of a tablet instead of entire tablets. This decoupled the a table's partitioning scheme from its read concurrency limitations.

      It'd be great if we could expose chunked-token-hydration in the C++ client so that Impala can begin generating these chunked tokens and then hydrating them into smaller scanners in its backend.

      Attachments

        Activity

          People

            Unassigned Unassigned
            awong Andrew Wong
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: