[CASSANDRA-1368] Add output support for Hadoop Streaming

• Type: New Feature
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 0.7 beta 2
• Assignee: Stu Hood
• Reporter: Stu Hood

Authors

Stu Hood

Reviewers

Jonathan Ellis

• Created: 06/Aug/10 16:03
• Updated: 16/Apr/19 09:33
• Resolved: 03/Sep/10 21:12

Description

Hadoop Streaming is a framework that allows mapreduce jobs to be written in languages other than Java, by performing simple IPC on stdin/stdout.

Adding output support for Hadoop Streaming to Cassandra would mean that users could write very simple scripts in dynamic languages to load data into Cassandra. Once our Hadoop OutputFormat has stabilized a bit, we might also be able to this code to provide scalable bulk loading.

Issue Links

• blocks: CASSANDRA-1434 ColumnFamilyOutputFormat performs blocking writes for large batches
• is blocked by: CASSANDRA-1315 ColumnFamilyOutputFormat should use client API objects
• relates to: CASSANDRA-1497 Add input support for Hadoop Streaming