[CASSANDRA-3859] Add Progress Reporting to Cassandra OutputFormats

• Type: Improvement
• Status: Resolved
• Priority: Low
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Legacy/Tools
• Labels: bulkloader hadoop mapreduce sstableloader
• Assignee: Brandon Williams
• Reporter: Samarth Gahire

Authors

Brandon Williams

Reviewers

Chris Goffinet

• Created: 06/Feb/12 06:15
• Updated: 16/Apr/19 09:32
• Resolved: 19/Mar/12 18:52

Description

When we are using the BulkOutputFormat to load the data to cassandra. We should use the progress reporting to Hadoop Job within Sstable loader because while loading the data for particular task if streaming is taking more time and progress is not reported to Job it may kill the task with timeout exception.

Issue Links

• blocks: CASSANDRA-3945 Support incremental/batch sizes for BulkRecordWriter, due to GC overhead issues