Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3943

Use separate threshold configurations for disk-full detection and disk-not-full detection.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: nodemanager
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Use separate threshold configurations to check when disks become full and when disks become good. Currently the configuration "yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage" and "yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb" are used to check both when disks become full and when disks become good. It will be better to use two configurations: one is used when disks become full from not-full and the other one is used when disks become not-full from full. So we can avoid oscillating frequently.
      For example: we can set the one for disk-full detection higher than the one for disk-not-full detection.

        Attachments

        1. YARN-3943.000.patch
          25 kB
          zhihai xu
        2. YARN-3943.001.patch
          20 kB
          zhihai xu
        3. YARN-3943.002.patch
          18 kB
          zhihai xu

          Activity

            People

            • Assignee:
              zxu zhihai xu
              Reporter:
              zxu zhihai xu
            • Votes:
              1 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: