Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2710

TEZ_TASK_SCALE_MEMORY_RESERVE_FRACTION should be configurable at vertex level

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      Was trying to set TezConfiguration.TEZ_TASK_SCALE_MEMORY_RESERVE_FRACTION used by WeightedScalingMemoryDistributor at vertex level. But it failed with

      "tez.task.scale.memory.reserve-fraction is set at the scope of VERTEX, but it is only valid in the scope of AM"

      Even otherwise sseth was telling me that vertex.setConf() does not work as it is supposed to and not taken into account with container reuse.

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. TEZ-3286 Allow clients to set processor reserved memory per vertex (instead of per container)

          • Major - Major loss of function.
          • Closed
          is required by

          Bug - A problem which impairs or prevents the functions of the product. PIG-4626 [Pig on Tez] OOM in case of multiple outputs and POPartialAgg

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              rohini Rohini Palaniswamy
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: