Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6167

bin/hadoop script doesn't allow for different memory settings for each daemon type

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 0.20.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      bin/hadoop assumes that all daemon types ( namenode, datanode, jobtracker, tasktracker ), all use the same memory settings.. (HADOOP_HEAPSIZE).

      I propose changes to that script to allow overriding the default memory ( HADOOP_HEAPSIZE ), with daemon specific OPTS (HADOOP_NAMENODE_OPTS, etc ).

      Basically at the bottom of the bin/hadoop script, it will check to see if the user has already set "-Xmx" in the HADOOP_OPTS variable.. if so, then it will ignore the JAVA_HEAP_SIZE variable..

      as such:

      1. run it
        if [[ $HADOOP_OPTS == -Xmx ]]; then
        exec "$JAVA" $HADOOP_OPTS -classpath "$CLASSPATH" $CLASS "$@"
        else
        exec "$JAVA" $JAVA_HEAP_MAX $HADOOP_OPTS -classpath "$CLASSPATH" $CLASS "$@"
        fi

      I will attach the file as I have modified it..

        Attachments

        1. hadoop
          10 kB
          Fernando Padilla
        2. hadoop-script.diff
          0.8 kB
          Fernando Padilla

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                fern Fernando Padilla
              • Votes:
                2 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: