[CASSANDRA-4886] Remote ColumnFamilyInputFormat

• Type: Improvement
• Status: Resolved
• Priority: Normal
• Resolution: Won't Fix
• Fix Version/s: 3.11.5
• Assignee: Unassigned
• Reporter: Scott Fines
• Created: 31/Oct/12 17:12
• Updated: 01/Aug/21 11:28
• Resolved: 07/Dec/15 15:01

Description

As written, the ColumnFamilyInputFormat does not have a great deal of fault tolerance.

It only attempts to perform a read from a single replica, with an infinite timeout. If that replica is not available, then the Task fails, and must be retried on a different node.

This is fine if the TaskTrackers are colocated with Cassandra nodes, but is very fragile when this is not possible. When the Tasktrackers are remote to cassandra, the same rules about clients should apply--there should be a strict (configurable) timeout, and the ability to retry requests on a different replica if at single request fails.

It seems obvious that we'd want to support both types of architecture; to do that, we should probably have a configuration which allows the user to specify his architecture choices explicitely.

Issue Links

• relates to: CASSANDRA-2388 ColumnFamilyRecordReader fails for a given split because a host is down, even if records could reasonably be read from other replica.