Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-397

Separation of JVM heap region and off-heap memory region

    XMLWordPrintableJSON

    Details

      Description

      In order to avoid memory overuse ahead of time,  which may lead to executor failure, we have to safely separate the portions of memory that the JVM heap, off-heap and 'slack' share. The current implementation ([PR: NEMO-388|https://github.com/apache/incubator-nemo/pull/223]) does not guarantee this, allocating the off-heap memory on-demand. Off-heap region size will be given as a ratio of executor memory just like the slack size. Since off-heap memory is used in various types of Blocks, off-heap memory should be retained. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                haeyoon Haeyoon Cho
                Reporter:
                haeyoon Haeyoon Cho
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m