Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-2556

use asynchronous calls to scale BatchReader client calls

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: client
    • Labels:
      None

      Description

      Presently, the BatchReader uses a thread-pool to make synchronous calls to tablet servers to fetch data. That limits the number of tablet servers that can be doing queries in parallel. On very large clusters, clients may not initiate queries to all of the servers until some queries finish. It is not practical to create thousands of threads just to initiate queries.

      Alternatively, asynchronous calls can efficiently initiate queries an wait for responses, without using threads just to wait on responses.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              ecn Eric Newton
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: