[IMPALA-9253] Blacklist additional posix error codes for failed DataStreamService RPCs

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Distributed Exec
• Epic Color: ghx-label-8
• Assignee: Unassigned
• Reporter: Sahil Takiar
• Created: 16/Dec/19 21:08
• Updated: 21/Dec/20 20:44

Description

Filing as a follow up to IMPALA-9137, IMPALA-9137 blacklists a node if a RPC fails with specific posix error codes:

• 107 = ENOTCONN: Transport endpoint is not connected
• 108 = ESHUTDOWN: Cannot send after transport endpoint shutdown
• 111 = ECONNREFUSED: Connection refused

These codes were produced by running a query, killing a node running that query, and then seeing what error codes the query failed with.

There may be other error codes that are worth using for node blacklisting as well. One way to come up with more error codes is to use iptables to introduce network faults between Impala processes and see how RPCs fail.

Issue Links

• is related to: IMPALA-9137 Blacklist node if a DataStreamService RPC to the node fails