[CASSANDRA-5286] Streaming 2.0

• Type: Improvement
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 2.0 beta 1
• Labels: streaming
• Assignee: Yuki Morishita
• Reporter: Yuki Morishita

Authors

Yuki Morishita

Reviewers

Sylvain Lebresne

• Created: 25/Feb/13 18:46
• Updated: 16/Apr/19 09:32
• Resolved: 21/Jun/13 01:25

Description

2.0 is the good time to redesign streaming API including protocol to make streaming more performant and reliable.

Design goals that come up in my mind:

Better performance

• Protocol optimization
• Stream multiple files in parallel (CASSANDRA-4663)
• Persistent connection (CASSANDRA-4660)

Better control

• Cleaner API for error handling
• Integrate both IN/OUT streams into one session, so the components(bootstrap, move, bulkload, repair...) that use streaming can manage them easily.

Better reporting

• Better logging/tracing
• More metrics
• Progress reporting API for external client

Issue Links

• is duplicated by: CASSANDRA-5717 Repair causes streaming errors
• is duplicated by: CASSANDRA-5522 Migrate FileStreamTask to Guava RateLimiter and remove homegrown Throttle