Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-4570

Reduce memory footprint of OMUpdateEventBatch for Recon when processing OM update events

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0
    • None

    Description

      We are experiencing OOM when Recon heap size is too small (1GB) and it looks like OMUpdateEventBatch#events is taking most of them.

      Goal:
      1. Reduce new object creation when Recon is consuming batches OM events (consumeOMEvents)
      2. Improve OMUpdateEventBatch#filter to reduce memory usage. e.g. avoid generating a new list?

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            smeng Siyao Meng
            smeng Siyao Meng
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment