Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5564

hadoop command uses large JVM heap size

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.0
    • Component/s: build
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Command used to determine JAVA_PLATFORM in bin/hadoop command does not set the heap size. The command uses default 1GB heap size. The tasks invoking hadoop command end up using large heap size in streaming jobs. If the maximum memory that can be used by a task is restricted, this could result in map/reduce job failures.

        Attachments

        1. 5564.trunk.patch
          0.7 kB
          Suresh Srinivas
        2. 5564.trunk.patch
          0.7 kB
          Suresh Srinivas
        3. 5564.patch
          0.7 kB
          Suresh Srinivas

          Activity

            People

            • Assignee:
              sureshms Suresh Srinivas
              Reporter:
              sureshms Suresh Srinivas
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: