Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9435

Usability enhancements for the data cache access trace

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 3.4.0
    • Impala 4.0.0
    • Backend
    • None

    Description

      In IMPALA-8542, we added an access trace to the data cache. This outputs a JSON entry with information about each hit/miss. Currently it is controlled by the data_cache_enable_tracing startup parameter, and it will trace all accesses to a single file. There are a few enhancements that would make this easier to enable:

      1. Limit the number of access trace entries stored on disk to avoid unlimited disk usage. This can be done by switching to use be/src/util/simple-logger.h rather than a single file. The number of retained entries should be configurable.
      2. Implement a way to trace a subset of accesses (e.g. 5%)
      3. Optionally provide a way to start/stop logging without restart (e.g. via the WebUI)

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            joemcdonnell Joe McDonnell
            joemcdonnell Joe McDonnell
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment