Uploaded image for project: 'Apache Twill'
  1. Apache Twill
  2. TWILL-90

Add supports for setting resource capability for the AM

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0
    • Component/s: api, core, yarn
    • Labels:

      Description

      Currently the resource capability of the AM is fixed at 512MB and 1 core. It'd be good for the client be able to change that.

        Issue Links

          Activity

          Hide
          gourav Gourav Khaneja added a comment -

          How should the client determine the resource capability of AM ? Should it be a user specified param (specified in the TwillSpecification) ? Or should it be a function of amount of work AM needs to do (for example, how many runnables AM needs to start) ?

          Show
          gourav Gourav Khaneja added a comment - How should the client determine the resource capability of AM ? Should it be a user specified param (specified in the TwillSpecification) ? Or should it be a function of amount of work AM needs to do (for example, how many runnables AM needs to start) ?
          Hide
          hsaputra Henry Saputra added a comment -

          It is easier to do user specific params but if it not exist we could add param to enable math to estimate needed resources.

          Show
          hsaputra Henry Saputra added a comment - It is easier to do user specific params but if it not exist we could add param to enable math to estimate needed resources.
          Hide
          hsaputra Henry Saputra added a comment -
          Show
          hsaputra Henry Saputra added a comment - This seems relates to https://issues.apache.org/jira/browse/YARN-1197 ?
          Hide
          chtyim Terence Yim added a comment -

          The YARN-1197 is more about changing it dynamically while the container is running. This issue is more about having a way for user to set the AM resource capability (which is currently hardcoded).

          Show
          chtyim Terence Yim added a comment - The YARN-1197 is more about changing it dynamically while the container is running. This issue is more about having a way for user to set the AM resource capability (which is currently hardcoded).
          Hide
          hsaputra Henry Saputra added a comment -

          Thanks for clarifying =)

          Show
          hsaputra Henry Saputra added a comment - Thanks for clarifying =)
          Hide
          githubbot ASF GitHub Bot added a comment -

          GitHub user chtyim opened a pull request:

          https://github.com/apache/twill/pull/36

          (TWILL-90) Add new configuration options to set AM memory size

          You can merge this pull request into a Git repository by running:

          $ git pull https://github.com/chtyim/twill feature/TWILL-90

          Alternatively you can review and apply these changes as the patch at:

          https://github.com/apache/twill/pull/36.patch

          To close this pull request, make a commit to your master/trunk branch
          with (at least) the following in the commit message:

          This closes #36


          commit c085671661fce24c120cd9677ca07b9914ef0a0a
          Author: Terence Yim <chtyim@apache.org>
          Date: 2017-03-16T21:27:25Z

          (TWILL-90) Add new configuration options to set AM memory size


          Show
          githubbot ASF GitHub Bot added a comment - GitHub user chtyim opened a pull request: https://github.com/apache/twill/pull/36 ( TWILL-90 ) Add new configuration options to set AM memory size You can merge this pull request into a Git repository by running: $ git pull https://github.com/chtyim/twill feature/ TWILL-90 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/twill/pull/36.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #36 commit c085671661fce24c120cd9677ca07b9914ef0a0a Author: Terence Yim <chtyim@apache.org> Date: 2017-03-16T21:27:25Z ( TWILL-90 ) Add new configuration options to set AM memory size
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user anwar6953 commented on the issue:

          https://github.com/apache/twill/pull/36

          LGTM

          Show
          githubbot ASF GitHub Bot added a comment - Github user anwar6953 commented on the issue: https://github.com/apache/twill/pull/36 LGTM
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user chtyim commented on the issue:

          https://github.com/apache/twill/pull/36

          Thanks for the review.

          Show
          githubbot ASF GitHub Bot added a comment - Github user chtyim commented on the issue: https://github.com/apache/twill/pull/36 Thanks for the review.
          Hide
          githubbot ASF GitHub Bot added a comment -

          Github user asfgit closed the pull request at:

          https://github.com/apache/twill/pull/36

          Show
          githubbot ASF GitHub Bot added a comment - Github user asfgit closed the pull request at: https://github.com/apache/twill/pull/36

            People

            • Assignee:
              chtyim Terence Yim
              Reporter:
              chtyim Terence Yim
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development