Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7500

LogAggregation DeletionService should consider completedTime for long running jobs

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.7.3
    • Fix Version/s: None
    • Component/s: log-aggregation
    • Labels:
      None

      Description

      Currently LogAggregation deletes the application logs based on start time of the job. For long running jobs (started before yarn.log-aggregation.retain-seconds), say it is failed yesterday for some reason and we won't have the job logs today for debugging.

      Better to consider the completedTime of the job as part of the deletion condition.

        Attachments

          Activity

            People

            • Assignee:
              prabhujoseph Prabhu Joseph
              Reporter:
              prabhujoseph Prabhu Joseph
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: