Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-4343 Tez supportability improvements
  3. TEZ-4339

Expose real-time memory consumption of AM and task containers via DagClient

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.10.2
    • None
    • None

    Description

      The idea is to simply expose how much memory do all the containers (that belong to the current DAG) consume. This info could be very useful for developers, or anyone who would want to monitor their applications.
      I'm not yet sure how wasteful this addition would be in terms of client <-> AM communication, thinking about turning this feature off by default.

      Attachments

        Issue Links

          is required by

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-25666 Realtime memory usage in beeline progress

          • Major - Major loss of function.
          • Open
          relates to

          Sub-task - The sub-task of the issue TEZ-4358 Make memory usage provided by DagClient be extensible without further changes

          • Major - Major loss of function.
          • Open
          links to

          Web Link GitHub Pull Request #157

          Activity

            People

              abstractdog László Bodor
              abstractdog László Bodor
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 10m
                  2h 10m