[CASSANDRA-1050] Too many splits for ColumnFamily with only a few rows

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 0.7 beta 1
• Labels: hadoop keyspace split
• Severity: Normal
• Assignee: Johan Oskarsson
• Reporter: Joost Ouwerkerk

Authors

Johan Oskarsson

• Created: 04/May/10 19:31
• Updated: 16/Apr/19 09:33
• Resolved: 25/May/10 07:41

Description

ColumnFamilyInputFormat creates splits for the entire Keyspace. If one ColumnFamily has 100 Million rows and another has only 100 rows, the number of splits will be the 1,526 (assuming 64k rows per split) for either one, since it is based on the total number of unique keys across the whole keyspace, and not on the number of rows in the ColumnFamily.