Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-13557

Logging improvements for PDS memory restore process

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.11
    • Component/s: persistence
    • Labels:
      None
    • Release Note:
      Adding progress logging when restoring the statuses of partitions along with the output of the top partitions, the processing time of which took the longest.
    • Ignite Flags:
      Release Notes Required

      Description

      During partition state restore phase of restoring memory state from disk Ignite logs a lot of useful information on debug level but very little on info.
      In many situations more detailed information can be useful for identification of performance issues but printing info about all partitions is impractical as it produces too much logs.

      The following improvements are possible though:

      1. To identify any imbalance between partitions and find bigger-than-average partitions we should gather statistics for each partition during restore (part size and time it took to restore it). After restore we'll print information about average time and top five partitions that took the most time to restore.
      2. To make progress of restoring visible we should print short message with intermediate progress information periodically. This should be applied when restore starts taking too long time (e.g. if restore hasn't finished in 5 minutes start printing progress each minute).

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ktkalenko@gridgain.com Kirill Tkalenko
                Reporter:
                sergeychugunov Sergey Chugunov
                Reviewer:
                Ivan Bessonov
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h