[CASSANDRA-9302] Optimize cqlsh COPY FROM, part 3

• Type: Improvement
• Status: Resolved
• Priority: Urgent
• Resolution: Fixed
• Fix Version/s: 2.1.13, 2.2.5, 3.0.3, 3.2
• Component/s: Legacy/Tools
• Impacts: Docs
• Assignee: Stefania Alborghetti
• Reporter: Jonathan Ellis

Authors

Stefania Alborghetti

Reviewers

Adam Holmberg

• Created: 05/May/15 14:59
• Updated: 06/Nov/19 22:05
• Resolved: 16/Dec/15 11:41

Description

We've had some discussion moving to Spark CSV import for bulk load in 3.x, but people need a good bulk load tool now. One option is to add a separate Java bulk load tool (CASSANDRA-9048), but if we can match that performance from cqlsh I would prefer to leave COPY FROM as the preferred option to which we point people, rather than adding more tools that need to be supported indefinitely.

Previous work on COPY FROM optimization was done in CASSANDRA-7405 and CASSANDRA-8225.

Issue Links

• blocks: CASSANDRA-9494 Need to set TTL with COPY command
• blocks: CASSANDRA-10642 cqlsh COPY bulk round trip dtest flaps on Windows
• blocks: CASSANDRA-9303 Match cassandra-loader options in COPY FROM
• breaks: CASSANDRA-11375 COPY FROM fails when importing blob
• duplicates: CASSANDRA-10642 cqlsh COPY bulk round trip dtest flaps on Windows
• duplicates: CASSANDRA-7793 Utilize BATCH statements in COPY FROM
• duplicates: CASSANDRA-9061 Add backoff and recovery to cqlsh COPY FROM when write timeouts occur
• is blocked by: CASSANDRA-9304 COPY TO improvements
• relates to: CASSANDRA-10318 Update cqlsh COPY for new internal driver serialization interface
• relates to: CASSANDRA-11053 COPY FROM on large datasets: fix progress report and optimize performance part 4
• links to: 2.1 patch
• links to: 2.2 patch
• links to: 3.0 patch
• links to: dtest pull request
• links to: dtests