Hadoop Common
  1. Hadoop Common
  2. HADOOP-6167

bin/hadoop script doesn't allow for different memory settings for each daemon type

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: 0.20.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      bin/hadoop assumes that all daemon types ( namenode, datanode, jobtracker, tasktracker ), all use the same memory settings.. (HADOOP_HEAPSIZE).

      I propose changes to that script to allow overriding the default memory ( HADOOP_HEAPSIZE ), with daemon specific OPTS (HADOOP_NAMENODE_OPTS, etc ).

      Basically at the bottom of the bin/hadoop script, it will check to see if the user has already set "-Xmx" in the HADOOP_OPTS variable.. if so, then it will ignore the JAVA_HEAP_SIZE variable..

      as such:

      1. run it
        if [[ $HADOOP_OPTS == -Xmx ]]; then
        exec "$JAVA" $HADOOP_OPTS -classpath "$CLASSPATH" $CLASS "$@"
        else
        exec "$JAVA" $JAVA_HEAP_MAX $HADOOP_OPTS -classpath "$CLASSPATH" $CLASS "$@"
        fi

      I will attach the file as I have modified it..

      1. hadoop-script.diff
        0.8 kB
        Fernando Padilla
      2. hadoop
        10 kB
        Fernando Padilla

        Issue Links

          Activity

          Fernando Padilla created issue -
          Fernando Padilla made changes -
          Field Original Value New Value
          Attachment hadoop [ 12414298 ]
          Fernando Padilla made changes -
          Attachment hadoop-script.diff [ 12414397 ]
          Allen Wittenauer made changes -
          Link This issue duplicates HADOOP-6168 [ HADOOP-6168 ]
          Allen Wittenauer made changes -
          Link This issue is duplicated by HADOOP-9902 [ HADOOP-9902 ]
          Allen Wittenauer made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Duplicate [ 3 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Fernando Padilla
            • Votes:
              2 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development