Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3552

Make incremental stats max serialized size configurable or dramatically increase limit.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: Impala 2.5.0
    • Fix Version/s: Impala 2.8.0
    • Component/s: Catalog
    • Labels:

      Description

      The fix for IMPALA-2648/IMPALA-2664 introduced a conservative limitation on the maximum serialized size of incremental stats. As a result, some users with very large tables experienced regressions when upgrading because incremental stats did not work anymore.

      We should consider making the limit configurable, or even better fix the design to allow a much higher limit.

      Dimitris, assigning to you for triage/consideration.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                bharathv bharath v
                Reporter:
                alex.behm Alexander Behm
              • Votes:
                3 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: