Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.7.0
    • Component/s: replication
    • Labels:
      None

      Description

      Noticed that during high ingest load, there's a bit of downtime between iterations as, after the batch size is reached, the tserver records the progress it made, and it waits for the master to re-queue the file.

      This is a bit silly as the tserver could just continue to replicate from where it left off to reduce the latency in waiting to replicate the file. The remote side will still buffer, so we shouldn't be oversaturating the remote.

        Activity

        Hide
        ASF subversion and git services added a comment -

        Commit 0f6b6d0fb091440ad4780db1cf3c11f4a606de59 in accumulo's branch refs/heads/ACCUMULO-378 from Josh Elser
        [ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=0f6b6d0 ]

        ACCUMULO-2834 First attempt at immediately requeueing a file for replication when more work is needed.

        Show
        ASF subversion and git services added a comment - Commit 0f6b6d0fb091440ad4780db1cf3c11f4a606de59 in accumulo's branch refs/heads/ ACCUMULO-378 from Josh Elser [ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=0f6b6d0 ] ACCUMULO-2834 First attempt at immediately requeueing a file for replication when more work is needed.
        Hide
        ASF subversion and git services added a comment -

        Commit 6653be00ca8efc85b7cc32bc13af8db1ed56a9a2 in accumulo's branch refs/heads/ACCUMULO-378 from Josh Elser
        [ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=6653be0 ]

        ACCUMULO-2834 It would help to actually invoke that new method.

        Show
        ASF subversion and git services added a comment - Commit 6653be00ca8efc85b7cc32bc13af8db1ed56a9a2 in accumulo's branch refs/heads/ ACCUMULO-378 from Josh Elser [ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=6653be0 ] ACCUMULO-2834 It would help to actually invoke that new method.

          People

          • Assignee:
            Josh Elser
            Reporter:
            Josh Elser
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development