HBase
  1. HBase
  2. HBASE-5618

SplitLogManager - prevent unnecessary attempts to resubmits

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.92.2, 0.94.0
    • Component/s: wal, Zookeeper
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently once a watch fires that the task node has been updated (hearbeated) by the worker, the splitlogmanager still quite some time before it updates the "last heard from" time. This is because the manager currently schedules another getDataSetWatch() and only after that finishes will it update the task's "last heard from" time.

      This leads to a large number of zk-BadVersion warnings when resubmission is continuously attempted and it fails.

      Two changes should be made
      (1) On a resubmission failure because of BadVersion the task's lastUpdate time should get upped.
      (2) The task's lastUpdate time should get upped as soon as the nodeDataChanged() watch fires and without waiting for getDataSetWatch() to complete.

        Activity

        Lars Hofhansl made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        stack made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 0.92.2 [ 12319888 ]
        Fix Version/s 0.94.0 [ 12316419 ]
        Resolution Fixed [ 1 ]
        Mikhail Bautin made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Prakash Khemani made changes -
        Prakash Khemani made changes -
        Prakash Khemani made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Prakash Khemani made changes -
        Prakash Khemani made changes -
        Prakash Khemani made changes -
        Assignee Prakash Khemani [ khemani ]
        stack made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Prakash Khemani made changes -
        Jonathan Hsieh made changes -
        Field Original Value New Value
        Component/s wal [ 12313572 ]
        Component/s zookeeper [ 12313582 ]
        Prakash Khemani created issue -

          People

          • Assignee:
            Prakash Khemani
            Reporter:
            Prakash Khemani
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development