Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-19317

Increase "yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage" to avoid host-related failures on MiniMRCluster

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      YARN (2.7.4, at least) defaults to asserting at least 10% of the disk usage free on the local machine in order for the NodeManagers to function.

      On my development machine, despite having over 50G free, I would see the warning from the NM that all the local dirs were bad which would cause the test to become stuck waiting to submit a mapreduce job. Surefire would eventually kill the process.

      We should increase this value to avoid it causing us headache.

        Attachments

        1. HBASE-19317.002.branch-2.patch
          2 kB
          Josh Elser
        2. HBASE-19317.001.branch-2.patch
          2 kB
          Josh Elser

          Activity

            People

            • Assignee:
              elserj Josh Elser
              Reporter:
              elserj Josh Elser
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: