Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-17998

Support limiting job history size

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      Flink history server stores information for an unlimited number of completed jobs, which is inconvenient to dig through on long-running instances and might cause performance degradation in the long run.

      Spark for example addresses this issue by limiting the number of jobs to keep by a configuration parameter spark.history.retainedApplications with a default of 50 jobs to keep.

      Introducing a similar configuration option to the Flink history server would improve the usability and performability of long-running history server instances.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              dmagyar Daniel Laszlo Magyar
              Reporter:
              dmagyar Daniel Laszlo Magyar

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment