Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-5618

SplitLogManager - prevent unnecessary attempts to resubmits

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.92.2, 0.94.0
    • Component/s: wal, Zookeeper
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently once a watch fires that the task node has been updated (hearbeated) by the worker, the splitlogmanager still quite some time before it updates the "last heard from" time. This is because the manager currently schedules another getDataSetWatch() and only after that finishes will it update the task's "last heard from" time.

      This leads to a large number of zk-BadVersion warnings when resubmission is continuously attempted and it fails.

      Two changes should be made
      (1) On a resubmission failure because of BadVersion the task's lastUpdate time should get upped.
      (2) The task's lastUpdate time should get upped as soon as the nodeDataChanged() watch fires and without waiting for getDataSetWatch() to complete.

        Attachments

          Activity

            People

            • Assignee:
              khemani Prakash Khemani
              Reporter:
              khemani Prakash Khemani
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: