Accumulo
  1. Accumulo
  2. ACCUMULO-2556

use asynchronous calls to scale BatchReader client calls

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: client
    • Labels:
      None

      Description

      Presently, the BatchReader uses a thread-pool to make synchronous calls to tablet servers to fetch data. That limits the number of tablet servers that can be doing queries in parallel. On very large clusters, clients may not initiate queries to all of the servers until some queries finish. It is not practical to create thousands of threads just to initiate queries.

      Alternatively, asynchronous calls can efficiently initiate queries an wait for responses, without using threads just to wait on responses.

        Activity

        Eric Newton created issue -

          People

          • Assignee:
            Unassigned
            Reporter:
            Eric Newton
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:

              Development