Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.98.0, 0.96.1, 0.99.0
    • Component/s: Performance, wal
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      As Himanshu points out in the the parent issue, HLogPE is using an unorthodox API appending edits to the WAL; it is using an API that is meant for tests only that does an append immediately followed by a sync call.

      In normal deploy, WAL appends are done as a bunch of appends followed by a sync on the tail of the transaction – not a sync per append.

      This issue is about changing HLogPE to use append and then sync. It also adds an argument so you can specifying batching of a set of appends before the sync is called. The latter lets HLogPE mimic multi puts that use the minibatch... which appends, appends, appends.. and then syncs.

      Assigning to Himanshu for review.

        Attachments

        1. addendum.0.96.txt
          0.9 kB
          stack
        2. 10094v2.txt
          10 kB
          stack

          Activity

            People

            • Assignee:
              v.himanshu Himanshu Vashishtha
              Reporter:
              stack stack
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: