Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-446

RocksDB: Fix misconfiguration of block cache size

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.0
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:
      None

      Description

      If rocksdb.cache.size.bytes is set, then it's not equally divided among all the containers, we can get rid of this configuration
      cacheSizePerContainer = storeConfig.getLong("rocksdb.cache.size.bytes", cacheSizePerContainer)

      We already have an configuration:
      val cacheSize = storeConfig.getLong("container.cache.size.bytes", 100 * 1024 * 1024L)
      which sets the block cache and is set divided amongst all tasks, which should be sufficient.

        Attachments

        1. SAMZA-446-0.patch
          1.0 kB
          Chris Riccomini

          Activity

            People

            • Assignee:
              criccomini Chris Riccomini
              Reporter:
              naveenatceg Naveen Somasundaram
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: