Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7739 Kafka Tiered Storage
  3. KAFKA-15157

Print startup time for RemoteIndexCache

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.6.0
    • None
    • None

    Description

      When RemoteIndexCache starts up, it will try to re-build the in-memory cache using the files already present on the disk in the remote-index-cache directory. The process involves:
      1. deleting existing files which are pending delete i.e. have a .delete suffix
      2. read the cached index files, if present.
      3. creating the indexes (this step will create a MMapped'buffer)
      4. perform sanity check on the indexes
      5. add to internal cache

      The steps 2-5 are bound by the maximum number of entries in the cache. But step 1 could be arbitrary large.

      To debug a slow cache startup, we should add a info statement that prints the time it took to initialize the cache.

      Attachments

        Issue Links

          Activity

            People

              isding_l Lan Ding
              divijvaidya Divij Vaidya
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: