[IMPALA-5541] Enforce sane maximum for BATCH_SIZE

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: Impala 2.10.0
• Fix Version/s: Impala 2.11.0
• Component/s: Backend
• Labels: ramp-up
• Epic Color: ghx-label-8
• Assignee: Tianyi Wang
• Reporter: Tim Armstrong
• Created: 20/Jun/17 17:17
• Updated: 14/Mar/18 23:35
• Resolved: 06/Nov/17 18:55

Description

We don't enforce maximums on BATCH_SIZE. Setting a very large value could cause strange behaviour like crashing, hanging, excessive memory usage, spinning etc.

I think a limit like 65536 (64x the default) would be reasonable but it's worth discussing further.

Sub-Tasks

• Document upper limit for BATCH_SIZE query option: Resolved