Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-7289 Memory allocation of RocksDB can be problematic in container environments
  3. FLINK-14483

Build and supply frocksdb version to support WriteBufferManager

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 1.10.0
    • Component/s: Runtime / State Backends
    • Labels:
      None
    • Release Note:
      Hide
      The FRocksDB version is bumped up to 5.17.2-artisans-2.0 which backports feature of write buffer manager and related configurations to limit the memory usage. This new version is supported only for OS X version >= 10.13.
      See also: https://github.com/facebook/rocksdb/issues/4862
      Show
      The FRocksDB version is bumped up to 5.17.2-artisans-2.0 which backports feature of write buffer manager and related configurations to limit the memory usage. This new version is supported only for OS X version >= 10.13. See also: https://github.com/facebook/rocksdb/issues/4862

      Description

      Since we still need to maintain our own FRocksDB, we need to provide new frocksDB version to support writebuffer manager.

        Attachments

        1. ppc64le-e2e-test.jpg
          646 kB
          Yun Tang
        2. state_benchmark_result_of_latest_FRocksDB-5.17.2.png
          542 kB
          Yu Li
        3. win64-e2e-test.jpg
          739 kB
          Yun Tang

          Issue Links

          Dependent

          Sub-task - The sub-task of the issue FLINK-15034 Bump FRocksDB version for memory control

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                yunta Yun Tang
                Reporter:
                yunta Yun Tang
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: