Accumulo
  1. Accumulo
  2. ACCUMULO-1962

Improve batch scanner throughput in failure case

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 1.7.0
    • Component/s: None
    • Labels:
      None

      Description

      The batch scanner currently does the following.

      1. bin ranges to tablets servers and tabelts
      2. if any ranges could not be binned (e.g. a tablet had no location) goto 1
      3. queue up work for tablet servers on a thread pool
      4. wait for thread pool to complete all work
      5. if there were any failures goto 1

      In the face of failures (tablets not assigned because of migration, tablet servers dying) it would be better if the batch scanner worked on what it could and immediately requeued failures for processing immediately. The ConditionalWriter and BatchWriter have failure queues and increase the retry time if something keeps failing.

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Unassigned
            Reporter:
            Keith Turner
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:

              Development