Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-1101 Make memory management adaptive
  3. FLINK-1232

Allow I/O spill file writers to work with futures/callbacks

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.8.0
    • Runtime / Task
    • None

    Description

      To simplify the implementation of the adaptive memory management, the asynchronous writers could use callbacks that are invoked when a memory has been successfully written.

      In the current solution, the thread writing memory segments to disk needs to keep track of how much was spilled and release that memory later.

      The callbacks can in that case release the memory directly. This is both simpler and less prone to leaks.

      Attachments

        Activity

          People

            sewen Stephan Ewen
            sewen Stephan Ewen
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: