Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4059 Pig on Spark
  3. PIG-4698

Enable dynamic resource allocation/de-allocation on Yarn backends

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: spark-branch
    • Fix Version/s: spark-branch
    • Component/s: spark
    • Labels:

      Description

      Resource elasticity needs to be enabled on Yarn backend to allow jobs to scale out better and provide better wall clock execution times, while unused resources should be released back to RM for use.

        Attachments

        1. PIG-4698.patch
          6 kB
          Srikanth Sundarrajan

          Issue Links

            Activity

              People

              • Assignee:
                sriksun Srikanth Sundarrajan
                Reporter:
                sriksun Srikanth Sundarrajan
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: