Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2664

prevent INCREMENTAL STATS to run when total size would exceed a threshold

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 2.3.0
    • Impala 2.5.0, Impala 2.3.2, Impala 2.2.9
    • None
    • None

    Description

      Computing incremental stats can take a large amount of space in the metastore and then on the wire between catalogd and impalad, which can lead to slowness or catalog crashes.

      Impala should fail COMPUTE INCREMENTAL STATS when the (estimated) size of incremental stats present in the metastore exceeds a given threshold.

      Attachments

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            bharathv Bharath Vissapragada
            srus Silvius Rus
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment