Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3943

Use separate threshold configurations for disk-full detection and disk-not-full detection.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • nodemanager
    • None
    • Reviewed

    Description

      Use separate threshold configurations to check when disks become full and when disks become good. Currently the configuration "yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage" and "yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb" are used to check both when disks become full and when disks become good. It will be better to use two configurations: one is used when disks become full from not-full and the other one is used when disks become not-full from full. So we can avoid oscillating frequently.
      For example: we can set the one for disk-full detection higher than the one for disk-not-full detection.

      Attachments

        1. YARN-3943.000.patch
          25 kB
          Zhihai Xu
        2. YARN-3943.001.patch
          20 kB
          Zhihai Xu
        3. YARN-3943.002.patch
          18 kB
          Zhihai Xu

        Activity

          People

            zxu Zhihai Xu
            zxu Zhihai Xu
            Votes:
            1 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: