Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2664

prevent INCREMENTAL STATS to run when total size would exceed a threshold

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Impala 2.3.0
    • Component/s: None
    • Labels:
      None

      Description

      Computing incremental stats can take a large amount of space in the metastore and then on the wire between catalogd and impalad, which can lead to slowness or catalog crashes.

      Impala should fail COMPUTE INCREMENTAL STATS when the (estimated) size of incremental stats present in the metastore exceeds a given threshold.

        Attachments

          Activity

            People

            • Assignee:
              bharathv bharath v
              Reporter:
              srus Silvius Rus
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: