Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-2835

Track explicit lengths of WALs for more accurate reporting

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Not A Bug
    • None
    • None
    • replication
    • None

    Description

      Presently, during the normal ingest path, the length of each WAL isn't explicitly tracked. In practice, it isn't necessary because we can read until the end of the file (EOFException) and track progress only from the beginning.

      This makes the bookkeeping easier, but it's then hard to assert intra-file progress for replication. The only accurate metric that can be made is the number of files needing replication, while the size actual amount of data that needs to be sent over the wire is unknown without reading the file to get the length in number of records.

      Attachments

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. ACCUMULO-2949 Write explicit "close" markers for WALs

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              elserj Josh Elser
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: