Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0, 2.2.0, 2.1.1, 2.0.3
    • Component/s: proc-v2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Keep seeing this

      2018-10-16,20:03:02,027 WARN [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: procedure WALs count=340 above the warning threshold 10. check running procedures to see if something is stuck.
      2018-10-16,20:03:02,027 INFO [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: Rolled new Procedure Store WAL, id=343
      2018-10-16,20:03:02,027 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=991, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,027 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=992, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,027 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=994, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,027 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=995, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,870 WARN [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: procedure WALs count=341 above the warning threshold 10. check running procedures to see if something is stuck.
      2018-10-16,20:03:02,870 INFO [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: Rolled new Procedure Store WAL, id=344
      2018-10-16,20:03:02,870 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=991, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,870 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=992, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,870 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=994, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:02,870 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=995, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:03,816 WARN [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: procedure WALs count=342 above the warning threshold 10. check running procedures to see if something is stuck.
      2018-10-16,20:03:03,816 INFO [WALProcedureStoreSyncThread] org.apache.hadoop.hbase.procedure2.store.wal.WALProcedureStore: Rolled new Procedure Store WAL, id=345
      2018-10-16,20:03:03,816 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=991, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:03,816 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=992, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:03,816 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=994, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      2018-10-16,20:03:03,816 DEBUG [Force-Update-PEWorker-0] org.apache.hadoop.hbase.procedure2.ProcedureExecutor: Procedure pid=995, ppid=990, state=SUCCESS; org.apache.hadoop.hbase.master.replication.RefreshPeerProcedure has already been finished, skip force updating.
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Apache9 Duo Zhang
                Reporter:
                Apache9 Duo Zhang
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: