Accumulo
  1. Accumulo
  2. ACCUMULO-2835

Track explicit lengths of WALs for more accurate reporting

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: replication
    • Labels:
      None

      Description

      Presently, during the normal ingest path, the length of each WAL isn't explicitly tracked. In practice, it isn't necessary because we can read until the end of the file (EOFException) and track progress only from the beginning.

      This makes the bookkeeping easier, but it's then hard to assert intra-file progress for replication. The only accurate metric that can be made is the number of files needing replication, while the size actual amount of data that needs to be sent over the wire is unknown without reading the file to get the length in number of records.

        Issue Links

          Activity

          Hide
          ASF subversion and git services added a comment -

          Commit 2425fd24be9c53bc3d42900b4ffc61043929d210 in accumulo's branch refs/heads/ACCUMULO-378 from Josh Elser
          [ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=2425fd2 ]

          ACCUMULO-2835 Log a todo

          Show
          ASF subversion and git services added a comment - Commit 2425fd24be9c53bc3d42900b4ffc61043929d210 in accumulo's branch refs/heads/ ACCUMULO-378 from Josh Elser [ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=2425fd2 ] ACCUMULO-2835 Log a todo

            People

            • Assignee:
              Unassigned
              Reporter:
              Josh Elser
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Development