Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-14524

HDFS Recommendation: dfs.datanode.du.reserved should be set to 10%-15% of volume size

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 2.1.0
    • 2.4.0
    • stacks
    • None

    Description

      PROBLEM: Ambari should give recommendations on this setting: dfs.datanode.du.reserved
      The default is 1GB and that is too low for a lot of our production customers. If this is too low and the space on the datanode fills up, the nodemanagers will start failing the health checks and we get into a bad state with not enough nodemanagers being up. At this point the admin tries to run the balancer and hope that it will balance very quickly.
      There should be a recommendation on this value based on the disk space available in the datanode volume. In addition, if the user sets it too low there should be a warning saying this will cause problems if enough buffer is not kept.

      Attachments

        1. AMBARI-14524.patch
          24 kB
          Dmytro Sen

        Issue Links

          Activity

            People

              dsen Dmytro Sen
              dsen Dmytro Sen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: