Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.9.0, 3.0.0-beta1, 2.8.2
    • Component/s: datanode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      The dataset lock is very highly contended. The unfair nature can be especially harmful to the heartbeat handling. Under high loads, partially expose by HDFS-12136 introducing disk i/o within the lock, the heartbeat handling thread may process commands so slowly due to the contention that the node becomes stale or falsely declared dead. The unfair lock is not helping and appears to be causing frequent starvation under load.

        Attachments

        1. HDFS-12137.trunk.patch
          1 kB
          Daryn Sharp
        2. HDFS-12137.trunk.patch
          1 kB
          Daryn Sharp
        3. HDFS-12137.branch-2.patch
          1 kB
          Daryn Sharp

          Activity

            People

            • Assignee:
              daryn Daryn Sharp
              Reporter:
              daryn Daryn Sharp
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: