Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-24120

Document MALLOC_ARENA_MAX as workaround for glibc memory leak

Agile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.14.0, 1.13.2
    • 1.14.0, 1.13.3
    • Documentation, flink-docker
    • flink on k8s

      flink version : 1.13.2

      state.backend: rocksdb

      state.checkpoints.dir: hdfs_url

      state.savepoints.dir: hdfs_url

      state.backend.rocksdb.memory.managed: true

       

    Description

      My task will do a savepoint every hour, so every hour will do a savepoint. From the memory monitoring, it can be seen that the memory of each hour will soar up, although the memory will drop a little later, but from every hour From the point of view of the memory peak on the whole point, the memory continues to rise little by little, and eventually rises to the limited memory, which will lead to being killed by k8S

       

       

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            wind_ljy Jiayi Liao
            593700624 no nO
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment