Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Not A Problem
    • Affects Version/s: None
    • Fix Version/s: 0.89-fb
    • Component/s: Scanners
    • Labels:

      Description

      A new scanner API for reducing unnecessary RPC calls:
      Motivation:

      1. RPC is expensive to both client and server.
      2. The most important function for scanning is getting data, but for each scanning process within a region, there are 3 times of RPC that doesn't transfer data: open, last next, and close, I want to remove them all (for most of the situation)

      Solution:

      1. a new scanner API (scanOpen) which has an option of transfer data along with the scannerID back in this call
      2. a new scanner API (scanNext) which is similar to current next, but returns flags of whether more data is available and whether need to scan next region. If no data left, automatically close the scanner.
      3. scanClose is still useful when you want to close the scanner before reach the end.

      For most of the meta-scan, only one RPC will fetch all lines.

        Activity

        Hide
        Elliott Clark added a comment -

        0.89-fb is no longer being actively maintained. If issues persist open an issue against the current master or stable versions.

        Show
        Elliott Clark added a comment - 0.89-fb is no longer being actively maintained. If issues persist open an issue against the current master or stable versions.

          People

          • Assignee:
            Elliott Clark
            Reporter:
            @deprecated Yi Deng
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development