Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-21171

[amv2] Tool to parse a directory of MasterProcWALs standalone

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-1, 2.2.0, 2.1.1
    • amv2, test
    • None
    • Reviewed
    • Hide
      Make it so can run the WAL parse and load system in isolation. Here is an example:

      {code}$ HBASE_OPTS=" -XX:+UnlockDiagnosticVMOptions -XX:+UnlockCommercialFeatures -XX:+FlightRecorder -XX:+DebugNonSafepoints" ./bin/hbase org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore ~/big_set_of_masterprocwals/
      {code}
      Show
      Make it so can run the WAL parse and load system in isolation. Here is an example: {code}$ HBASE_OPTS=" -XX:+UnlockDiagnosticVMOptions -XX:+UnlockCommercialFeatures -XX:+FlightRecorder -XX:+DebugNonSafepoints" ./bin/hbase org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore ~/big_set_of_masterprocwals/ {code}

    Description

      I want to be able to test parsing and be able to profile a standalone parse and WALProcedureStore load of procedures. Adding a simple main on WALProcedureStore seems to be enough. I tested parsing it a dir of hundreds of WALs to see what is going on when we try to load. Good for figuring how to log, where the memory is going, etc., in this subsystem.

      Attachments

        1. HBASE-21171.branch-2.1.003.patch
          5 kB
          Michael Stack
        2. HBASE-21171.branch-2.1.002.patch
          5 kB
          Michael Stack
        3. HBASE-21171.branch-2.1.001.patch
          5 kB
          Michael Stack

        Issue Links

          Activity

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: