[IMPALA-4683] Intelligently blacklist scratch disks with physical I/O errors

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 2.3.0, Impala 2.5.0, Impala 2.6.0, Impala 2.7.0, Impala 2.8.0
• Component/s: Backend
• Labels: resource-management
• Target Version: Product Backlog
• Assignee: Unassigned
• Reporter: Tim Armstrong
• Created: 16/Dec/16 16:37
• Updated: 10/Dec/19 01:32

Description

I'm splitting this out from IMPALA-2079 since there are really two different parts to that.

This JIRA is to track process-wide blacklisting of scratch directories on disks that exhibit physical I/O errors that may indicate a failing disk.

We do not necessarily want to permanently blacklist disks, since that can result in daemons being in a bad state where they can't allocate any scratch space until they are restarted. Instead we should consider time-base blacklisting or some kind of administrative support to reenabled blacklisted disks.

Issue Links

• is related to: IMPALA-9224 Blacklist nodes with faulty disks
• is related to: IMPALA-2079 Don't fail when write to scratch dir results in error.