Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3552

Make incremental stats max serialized size configurable or dramatically increase limit.

Agile BoardAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • Impala 2.5.0
    • Impala 2.8.0
    • Catalog

    Description

      The fix for IMPALA-2648/IMPALA-2664 introduced a conservative limitation on the maximum serialized size of incremental stats. As a result, some users with very large tables experienced regressions when upgrading because incremental stats did not work anymore.

      We should consider making the limit configurable, or even better fix the design to allow a much higher limit.

      Dimitris, assigning to you for triage/consideration.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            bharathv Bharath Vissapragada
            alex.behm Alexander Behm
            Votes:
            3 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment