HBase
  1. HBase
  2. HBASE-5618

SplitLogManager - prevent unnecessary attempts to resubmits

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.92.2, 0.94.0
    • Component/s: wal, Zookeeper
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently once a watch fires that the task node has been updated (hearbeated) by the worker, the splitlogmanager still quite some time before it updates the "last heard from" time. This is because the manager currently schedules another getDataSetWatch() and only after that finishes will it update the task's "last heard from" time.

      This leads to a large number of zk-BadVersion warnings when resubmission is continuously attempted and it fails.

      Two changes should be made
      (1) On a resubmission failure because of BadVersion the task's lastUpdate time should get upped.
      (2) The task's lastUpdate time should get upped as soon as the nodeDataChanged() watch fires and without waiting for getDataSetWatch() to complete.

        Activity

          People

          • Assignee:
            Prakash Khemani
            Reporter:
            Prakash Khemani
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development