Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-21171

[amv2] Tool to parse a directory of MasterProcWALs standalone

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0, 2.2.0, 2.1.1
    • Component/s: amv2, test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Make it so can run the WAL parse and load system in isolation. Here is an example:

      {code}$ HBASE_OPTS=" -XX:+UnlockDiagnosticVMOptions -XX:+UnlockCommercialFeatures -XX:+FlightRecorder -XX:+DebugNonSafepoints" ./bin/hbase org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore ~/big_set_of_masterprocwals/
      {code}
      Show
      Make it so can run the WAL parse and load system in isolation. Here is an example: {code}$ HBASE_OPTS=" -XX:+UnlockDiagnosticVMOptions -XX:+UnlockCommercialFeatures -XX:+FlightRecorder -XX:+DebugNonSafepoints" ./bin/hbase org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore ~/big_set_of_masterprocwals/ {code}

      Description

      I want to be able to test parsing and be able to profile a standalone parse and WALProcedureStore load of procedures. Adding a simple main on WALProcedureStore seems to be enough. I tested parsing it a dir of hundreds of WALs to see what is going on when we try to load. Good for figuring how to log, where the memory is going, etc., in this subsystem.

        Attachments

        1. HBASE-21171.branch-2.1.003.patch
          5 kB
          Michael Stack
        2. HBASE-21171.branch-2.1.002.patch
          5 kB
          Michael Stack
        3. HBASE-21171.branch-2.1.001.patch
          5 kB
          Michael Stack

          Issue Links

            Activity

              People

              • Assignee:
                stack Michael Stack
                Reporter:
                stack Michael Stack
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: