Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-7289 Memory allocation of RocksDB can be problematic in container environments
  3. FLINK-14483

Build and supply frocksdb version to support WriteBufferManager

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Done
    • None
    • 1.10.0
    • Runtime / State Backends
    • None
    • Hide
      The FRocksDB version is bumped up to 5.17.2-artisans-2.0 which backports feature of write buffer manager and related configurations to limit the memory usage. This new version is supported only for OS X version >= 10.13.
      See also: https://github.com/facebook/rocksdb/issues/4862
      Show
      The FRocksDB version is bumped up to 5.17.2-artisans-2.0 which backports feature of write buffer manager and related configurations to limit the memory usage. This new version is supported only for OS X version >= 10.13. See also: https://github.com/facebook/rocksdb/issues/4862

    Description

      Since we still need to maintain our own FRocksDB, we need to provide new frocksDB version to support writebuffer manager.

      Attachments

        1. state_benchmark_result_of_latest_FRocksDB-5.17.2.png
          542 kB
          Yu Li
        2. win64-e2e-test.jpg
          739 kB
          Yun Tang
        3. ppc64le-e2e-test.jpg
          646 kB
          Yun Tang

        Issue Links

          Dependent

          Sub-task - The sub-task of the issue FLINK-15034 Bump FRocksDB version for memory control

          • Major - Major loss of function.
          • Closed

          Activity

            People

              yunta Yun Tang
              yunta Yun Tang
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: