Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5541

Enforce sane maximum for BATCH_SIZE

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: Impala 2.10.0
    • Fix Version/s: Impala 2.11.0
    • Component/s: Backend
    • Labels:
    • Docs Text:
      The allowed range for the BATCH_SIZE query option is now [0,65536]. (Formerly, the upper bound was undefined.)
    • Epic Color:
      ghx-label-8

      Description

      We don't enforce maximums on BATCH_SIZE. Setting a very large value could cause strange behaviour like crashing, hanging, excessive memory usage, spinning etc.

      I think a limit like 65536 (64x the default) would be reasonable but it's worth discussing further.

        Attachments

        There are no Sub-Tasks for this issue.

          Activity

            People

            • Assignee:
              tianyiwang Tianyi Wang
              Reporter:
              tarmstrong Tim Armstrong
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: