Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-403

Remove 'transient' uses of SerializedPartition

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      There is a need to consider removing 'transient' uses of SerializedPartition - Use SerializedParition only for SerializedMemoryStore. FileBlock and ByteOutputContext should write directly to disks/network, not creating intermediary Serializedpartitions. This simplifies the usages of SerializedPartition#release() for off-heap memory management.

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. NEMO-388 Off-heap memory management (reuse ByteBuffer)

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              haeyoon Haeyoon Cho
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: