Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15532

Enable strict capacity limit for memory usage for RocksDB

    XMLWordPrintableJSON

Details

    Description

      Currently, due to the limitation of RocksDB (see issue-6247), we cannot create a strict-capacity-limit LRUCache which shared among rocksDB instance(s).

      This issue tracks this problem and offer the ability of strict mode once we could enable this feature.

      Attachments

        1. image-2020-10-23-14-55-08-120.png
          9 kB
          Peidian Li
        2. image-2020-10-23-14-43-18-739.png
          488 kB
          Peidian Li
        3. image-2020-10-23-14-41-10-584.png
          238 kB
          Peidian Li
        4. image-2020-10-23-14-39-45-997.png
          225 kB
          Peidian Li

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-14482 Bump up rocksdb version

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is related to

          Sub-task - The sub-task of the issue FLINK-15512 Refactor the mechanism of how to constructure the cache and write buffer manager shared across RocksDB instances

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          links to

          Web Link GitHub Pull Request #16835

          Activity

            People

              yunta Yun Tang
              yunta Yun Tang
              Votes:
              3 Vote for this issue
              Watchers:
              21 Start watching this issue

              Dates

                Created:
                Updated: