Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-397

Separation of JVM heap region and off-heap memory region

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      In order to avoid memory overuse ahead of time,  which may lead to executor failure, we have to safely separate the portions of memory that the JVM heap, off-heap and 'slack' share. The current implementation ([PR: NEMO-388|https://github.com/apache/incubator-nemo/pull/223]) does not guarantee this, allocating the off-heap memory on-demand. Off-heap region size will be given as a ratio of executor memory just like the slack size. Since off-heap memory is used in various types of Blocks, off-heap memory should be retained. 

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            haeyoon Haeyoon Cho Assign to me
            haeyoon Haeyoon Cho
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - Not Specified
              Not Specified
              Remaining:
              Remaining Estimate - 0h
              0h
              Logged:
              Time Spent - 20m
              20m

              Slack

                Issue deployment