Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None
    • Release Note:
      Hide
      New config added:

         // the maximum number of completed applications the RM keeps <name>yarn.server.resourcemanager.expire.applications.completed.max</name>
      Show
      New config added:    // the maximum number of completed applications the RM keeps <name>yarn.server.resourcemanager.expire.applications.completed.max</name>

      Description

      Today RM keeps the references of finished application for ever. Though this is not sustainable long term, it keeps
      the user experience saner. Users can revisit RM UI and check the status of their apps.

      We need to think of purging old references yet keeping the UX sane.

      1. MAPREDUCE-2649-v7.patch
        48 kB
        Thomas Graves
      2. MAPREDUCE-2649-v6.patch
        47 kB
        Thomas Graves
      3. MAPREDUCE-2649-v5.patch
        24 kB
        Thomas Graves
      4. MAPREDUCE-2649-v4.patch
        25 kB
        Thomas Graves
      5. MAPREDUCE-2649-v3.patch
        24 kB
        Thomas Graves
      6. MAPREDUCE-2649-v2.patch
        30 kB
        Thomas Graves
      7. MAPREDUCE-2649-patch-mr279.txt
        34 kB
        Thomas Graves

        Issue Links

          Activity

          Thomas Graves created issue -
          Thomas Graves made changes -
          Field Original Value New Value
          Attachment MAPREDUCE-2649-patch-mr279.txt [ 12488105 ]
          Thomas Graves made changes -
          Fix Version/s 0.23.0 [ 12315570 ]
          Thomas Graves made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note The new configs added are:

          + // time(in ms) between when the retire applications thread checks
          <name>yarn.server.resourcemanager.retireApps.check.interval</name>

          + // the length of time(in ms) the RM keeps a completed application
          <name>yarn.server.resourcemanager.retireApps.keep.period</name>

          + // the maximum number of completed applications per user RM keeps
          <name>yarn.server.resourcemanager.retireApps.user.completed.max</name>
          Thomas Graves made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Thomas Graves made changes -
          Link This issue depends on MAPREDUCE-2781 [ MAPREDUCE-2781 ]
          Thomas Graves made changes -
          Attachment MAPREDUCE-2649-v2.patch [ 12489851 ]
          Thomas Graves made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note The new configs added are:

          + // time(in ms) between when the retire applications thread checks
          <name>yarn.server.resourcemanager.retireApps.check.interval</name>

          + // the length of time(in ms) the RM keeps a completed application
          <name>yarn.server.resourcemanager.retireApps.keep.period</name>

          + // the maximum number of completed applications per user RM keeps
          <name>yarn.server.resourcemanager.retireApps.user.completed.max</name>
          The new configs added are:

            // time(in ms) between when the expire applications thread checks <name>yarn.server.resourcemanager.expire.applications.monitor.interval</name>
           
            // the length of time(in ms) the RM keeps a completed application
          <name>yarn.server.resourcemanager.expire.applications.interval</name>

             // the maximum number of completed applications per user RM keeps <name>yarn.server.resourcemanager.expire.applications.user.completed.max</name>
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Thomas Graves made changes -
          Link This issue depends on MAPREDUCE-2781 [ MAPREDUCE-2781 ]
          Thomas Graves made changes -
          Attachment MAPREDUCE-2649-v3.patch [ 12490171 ]
          Thomas Graves made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note The new configs added are:

            // time(in ms) between when the expire applications thread checks <name>yarn.server.resourcemanager.expire.applications.monitor.interval</name>
           
            // the length of time(in ms) the RM keeps a completed application
          <name>yarn.server.resourcemanager.expire.applications.interval</name>

             // the maximum number of completed applications per user RM keeps <name>yarn.server.resourcemanager.expire.applications.user.completed.max</name>
          New config added:

             // the maximum number of completed applications the RM keeps <name>yarn.server.resourcemanager.expire.applications.completed.max</name>
          Thomas Graves made changes -
          Attachment MAPREDUCE-2649-v4.patch [ 12490175 ]
          Thomas Graves made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Thomas Graves made changes -
          Attachment MAPREDUCE-2649-v5.patch [ 12490239 ]
          Thomas Graves made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Thomas Graves made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Thomas Graves made changes -
          Attachment MAPREDUCE-2649-v6.patch [ 12490960 ]
          Thomas Graves made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Thomas Graves made changes -
          Attachment MAPREDUCE-2649-v7.patch [ 12490962 ]
          Arun C Murthy made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Vinod Kumar Vavilapalli made changes -
          Link This issue relates to MAPREDUCE-2953 [ MAPREDUCE-2953 ]
          Vinod Kumar Vavilapalli made changes -
          Link This issue relates to MAPREDUCE-2941 [ MAPREDUCE-2941 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Thomas Graves
              Reporter:
              Thomas Graves
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development