[CASSANDRA-10347] Bulk Loader API could not tolerate even node failure

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 2.1.10, 2.2.2, 3.0.0 rc2
• Component/s: Legacy/Tools
• Severity: Normal
• Assignee: Paulo Motta
• Reporter: Shenghua Wan

Authors

Paulo Motta

Reviewers

Carl Yeksigian

• Created: 15/Sep/15 18:43
• Updated: 16/Apr/19 09:30
• Resolved: 01/Oct/15 12:21

Description

When user uses CqlBulkOutputFormat, it tries to stream to all the nodes in the token range, which includes the dead nodes. Therefore, the stream failed. There was a design in C* API to allow stream() method to have a list of ignore hosts, but it was not utilized.

The empty-argument stream() method is called in all existing versions of C*, i.e.
in v2.0.11, https://github.com/apache/cassandra/blob/cassandra-2.0.11/src/java/org/apache/cassandra/hadoop/AbstractBulkRecordWriter.java#L122
in v2.1.5, https://github.com/apache/cassandra/blob/cassandra-2.1.5/src/java/org/apache/cassandra/hadoop/AbstractBulkRecordWriter.java#L122
and current trunk branch https://github.com/apache/cassandra/blob/trunk/src/java/org/apache/cassandra/hadoop/cql3/CqlBulkRecordWriter.java#L241

Issue Links

• relates to: CASSANDRA-4047 Bulk hinting
• links to: 2.1 patch
• links to: 2.2+ patch