Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.12.0, 0.11.1
    • Component/s: conf and scripts
    • Labels:
      None

      Description

      The default heap size is too low. it can execute only one task simultaneously.
      We should increase it for newbie

        Activity

        Hide
        githubbot ASF GitHub Bot added a comment -

        GitHub user jinossy opened a pull request:

        https://github.com/apache/tajo/pull/950

        TAJO-2065: Increase default heap size.

        I've change the default value to following:
        `Default Xmx: 1G -> 5G`
        `tajo.task.resource.min.memory-mb: 500 -> 1000`
        `tajo.worker.resource.disks: 1 -> 2`
        `Default GC: -XX:+UseParallelOldGC`
        This configuration can execute 4 task simultaneously.

        You can merge this pull request into a Git repository by running:

        $ git pull https://github.com/jinossy/tajo TAJO-2065

        Alternatively you can review and apply these changes as the patch at:

        https://github.com/apache/tajo/pull/950.patch

        To close this pull request, make a commit to your master/trunk branch
        with (at least) the following in the commit message:

        This closes #950


        commit 43cacc23616427d3b7d8faa72a060b961c997f72
        Author: Jinho Kim <jhkim@apache.org>
        Date: 2016-01-28T06:27:06Z

        TAJO-2065: Increase default heap size.


        Show
        githubbot ASF GitHub Bot added a comment - GitHub user jinossy opened a pull request: https://github.com/apache/tajo/pull/950 TAJO-2065 : Increase default heap size. I've change the default value to following: `Default Xmx: 1G -> 5G` `tajo.task.resource.min.memory-mb: 500 -> 1000` `tajo.worker.resource.disks: 1 -> 2` `Default GC: -XX:+UseParallelOldGC` This configuration can execute 4 task simultaneously. You can merge this pull request into a Git repository by running: $ git pull https://github.com/jinossy/tajo TAJO-2065 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tajo/pull/950.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #950 commit 43cacc23616427d3b7d8faa72a060b961c997f72 Author: Jinho Kim <jhkim@apache.org> Date: 2016-01-28T06:27:06Z TAJO-2065 : Increase default heap size.
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user jihoonson commented on the pull request:

        https://github.com/apache/tajo/pull/950#issuecomment-176013529

        +1. This patch doesn't relate to the unit test.
        Ship it!

        Show
        githubbot ASF GitHub Bot added a comment - Github user jihoonson commented on the pull request: https://github.com/apache/tajo/pull/950#issuecomment-176013529 +1. This patch doesn't relate to the unit test. Ship it!
        Hide
        githubbot ASF GitHub Bot added a comment -

        Github user asfgit closed the pull request at:

        https://github.com/apache/tajo/pull/950

        Show
        githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/tajo/pull/950
        Hide
        jhkim Jinho Kim added a comment -

        committed it
        Thanks for your quick review!

        Show
        jhkim Jinho Kim added a comment - committed it Thanks for your quick review!
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-master-CODEGEN-build #666 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/666/)
        TAJO-2065: Increase default heap size. (jhkim: rev 06a095f068664ae08b7431e4217428807ca5cd8c)

        • tajo-dist/src/main/conf/tajo-env.sh
        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • tajo-docs/src/main/sphinx/configuration/worker_configuration.rst
        • tajo-dist/src/main/bin/tajo
        • tajo-dist/src/main/conf/tajo-site.xml.template
        • CHANGES
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-CODEGEN-build #666 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/666/ ) TAJO-2065 : Increase default heap size. (jhkim: rev 06a095f068664ae08b7431e4217428807ca5cd8c) tajo-dist/src/main/conf/tajo-env.sh tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java tajo-docs/src/main/sphinx/configuration/worker_configuration.rst tajo-dist/src/main/bin/tajo tajo-dist/src/main/conf/tajo-site.xml.template CHANGES
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-master-build #1069 (See https://builds.apache.org/job/Tajo-master-build/1069/)
        TAJO-2065: Increase default heap size. (jhkim: rev 06a095f068664ae08b7431e4217428807ca5cd8c)

        • tajo-docs/src/main/sphinx/configuration/worker_configuration.rst
        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • tajo-dist/src/main/bin/tajo
        • CHANGES
        • tajo-dist/src/main/conf/tajo-env.sh
        • tajo-dist/src/main/conf/tajo-site.xml.template
          TAJO-2065: Increase default heap size (missing change). (jhkim: rev a3b347f99c975f78a1cb6d6ace65929a5f28e091)
        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • tajo-core-tests/src/test/java/org/apache/tajo/master/scheduler/TestSimpleScheduler.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-build #1069 (See https://builds.apache.org/job/Tajo-master-build/1069/ ) TAJO-2065 : Increase default heap size. (jhkim: rev 06a095f068664ae08b7431e4217428807ca5cd8c) tajo-docs/src/main/sphinx/configuration/worker_configuration.rst tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java tajo-dist/src/main/bin/tajo CHANGES tajo-dist/src/main/conf/tajo-env.sh tajo-dist/src/main/conf/tajo-site.xml.template TAJO-2065 : Increase default heap size (missing change). (jhkim: rev a3b347f99c975f78a1cb6d6ace65929a5f28e091) tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java tajo-core-tests/src/test/java/org/apache/tajo/master/scheduler/TestSimpleScheduler.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-0.11.1-build #161 (See https://builds.apache.org/job/Tajo-0.11.1-build/161/)
        TAJO-2065: Increase default heap size. (jhkim: rev b198935cd94fc57bfc35347c4bf1665257900ef3)

        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • tajo-docs/src/main/sphinx/configuration/worker_configuration.rst
        • tajo-dist/src/main/bin/tajo
        • tajo-dist/src/main/conf/tajo-site.xml.template
        • tajo-dist/src/main/conf/tajo-env.sh
        • CHANGES
          TAJO-2065: Increase default heap size (missing change). (jhkim: rev 5f217cf8c08e4eebc7c67d2aba0e2109679db6c3)
        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • tajo-core-tests/src/test/java/org/apache/tajo/master/scheduler/TestSimpleScheduler.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-0.11.1-build #161 (See https://builds.apache.org/job/Tajo-0.11.1-build/161/ ) TAJO-2065 : Increase default heap size. (jhkim: rev b198935cd94fc57bfc35347c4bf1665257900ef3) tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java tajo-docs/src/main/sphinx/configuration/worker_configuration.rst tajo-dist/src/main/bin/tajo tajo-dist/src/main/conf/tajo-site.xml.template tajo-dist/src/main/conf/tajo-env.sh CHANGES TAJO-2065 : Increase default heap size (missing change). (jhkim: rev 5f217cf8c08e4eebc7c67d2aba0e2109679db6c3) tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java tajo-core-tests/src/test/java/org/apache/tajo/master/scheduler/TestSimpleScheduler.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Tajo-master-CODEGEN-build #667 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/667/)
        TAJO-2065: Increase default heap size (missing change). (jhkim: rev a3b347f99c975f78a1cb6d6ace65929a5f28e091)

        • tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java
        • tajo-core-tests/src/test/java/org/apache/tajo/master/scheduler/TestSimpleScheduler.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Tajo-master-CODEGEN-build #667 (See https://builds.apache.org/job/Tajo-master-CODEGEN-build/667/ ) TAJO-2065 : Increase default heap size (missing change). (jhkim: rev a3b347f99c975f78a1cb6d6ace65929a5f28e091) tajo-common/src/main/java/org/apache/tajo/conf/TajoConf.java tajo-core-tests/src/test/java/org/apache/tajo/master/scheduler/TestSimpleScheduler.java

          People

          • Assignee:
            jhkim Jinho Kim
            Reporter:
            jhkim Jinho Kim
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development