Uploaded image for project: 'ZooKeeper'
  1. ZooKeeper
  2. ZOOKEEPER-3427

Introduce SnapshotComparer that assists debugging with snapshots.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.6.0
    • Fix Version/s: None
    • Component/s: server

      Description

      SnapshotComparer is a tool that loads and compares two snapshots, with configurable threshold and various filters. It's useful in use cases that involve snapshot analysis, such as offline data consistency checking, and data trending analysis (e.g. what's growing under which zNode path during when). 

      A sample output of the tool (actual numbers removed, due to sensitivity).

      Successfully parsed options!
      
      Deserialized snapshot in snapshot.0 in  seconds
      
      Processed data tree in seconds
      
      Deserialized snapshot in snapshot.1 in  seconds
      
      Processed data tree in seconds
      
      Node count: 
      
      Total size: 
      
      Max depth: 
      
      Count of nodes at depth 1: 
      
      Count of nodes at depth 2: 
      
      Count of nodes at depth 3: 
      
      Count of nodes at depth 4: 
      
      Count of nodes at depth 5: 
      
      Count of nodes at depth 6: 
      
      Count of nodes at depth 7: 
      
      Count of nodes at depth 8: 
      
      Count of nodes at depth 9: 
      
      Count of nodes at depth 10: 
      
      Count of nodes at depth 11: 
      
      
      Node count: 
      
      Total size: 
      
      Max depth: 
      
      Count of nodes at depth 1: 
      
      Count of nodes at depth 2: 
      
      Count of nodes at depth 3: 
      
      Count of nodes at depth 4: 
      
      Count of nodes at depth 5:
      
      Count of nodes at depth 6:
      
      Count of nodes at depth 7: 
      
      Count of nodes at depth 8: 
      
      Count of nodes at depth 9: 
      
      Count of nodes at depth 10: 
      
      Count of nodes at depth 11: 
      
      
      
      
      Analysis for depth 0
      
      Analysis for depth 1
      
      Analysis for depth 2
      
      Analysis for depth 3
      
      Analysis for depth 4
      
      Analysis for depth 5
      
      Analysis for depth 6
      
      Analysis for depth 7
      
      Analysis for depth 8
      
      Analysis for depth 9
      
      Analysis for depth 10
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                mengyaow Maya Wang
                Reporter:
                hanm Michael Han
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 20m
                  3h 20m