Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-7954 Support automatic invalidates using metastore notification events
  3. IMPALA-7975

Improve supportability of the automatic invalidate feature

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • Impala 3.2.0
    • None
    • None
    • ghx-label-3

    Description

      Some of the things which can be done to improve supportability of this feature:

      • Add metrics to detect issues pertaining to this feature
      1. Time taken to fetch the notifications (Would be useful to have average, min, max)
      2. Time taken to process a batch of events received
      3. Number of times particular table was invalidated (would be useful to have some rate metric like number_of_invalidates/per_hour)
      • Ability to turn ON/OFF for this feature (possibly without the need of a restart)

      Attachments

        Issue Links

          is related to

          Sub-task - The sub-task of the issue IMPALA-8296 Impala Doc: Doc the supportability metrics of the automatic metadata invalidate feature

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-12053 Expose event-processor error message in catalogd WebUI

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link gerrit_review

          Activity

            People

              vihangk1 Vihang Karajgaonkar
              vihangk1 Vihang Karajgaonkar
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: