Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2731

Set yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage to a higher value in tests

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • trunk
    • 5.0.0b1
    • tests
    • None

    Description

      We should set yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage to a higher value in the mini cluster during tests (default is 90.0). This property determines the maximum percentage of disk space that can be utilized before the NodeManager goes to unhealthy and won't run any tasks. As-is, this means that if you have < 10% of your disk free, unit tests that submit Yarn jobs will fail because they can't run the job; and it's not always clear that this is the problem.

      We should set this to a higher value such as 99.0. Our unit tests don't need that much disk space.

      Attachments

        1. OOZIE-2731.PATCH-1.patch
          0.8 kB
          Attila Sasvári

        Activity

          People

            asasvari Attila Sasvári
            rkanter Robert Kanter
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: