[IMPALA-7732] Check / Implement resource limits documented in IMPALA-5605

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 3.0, Impala 2.12.0
• Component/s: Backend
• Target Version: Impala 4.3.0
• Epic Color: ghx-label-9
• Assignee: Unassigned
• Reporter: Michael Ho
• Created: 19/Oct/18 18:56
• Updated: 23/Nov/22 12:24

Description

IMPALA-5605 documents a list of recommended bump in system resource limits which may be necessary when running Impala at scale. We may consider checking those limits at startup with getrlimit() and potentially setting them with setrlimit() if possible. At the minimum, may be helpful to log a warning message if the limit is below certain threshold.