[SPARK-22911] Migrate structured streaming sources to new DataSourceV2 APIs - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

1.	Support v2 streaming sources and sinks in MicroBatchExecution	Resolved	Unassigned	Actions
2.	Migrate MemoryStream to V2	Resolved	Unassigned	Actions
3.	Migrate MemorySink fully to v2	Resolved	Gabor Somogyi	Actions
4.	Migrate Microbatch ConsoleSink to v2	Resolved	Jose Torres	Actions
5.	Migrate rate source to v2	Resolved	Saisai Shao	Actions
6.	Migrate text socket source to v2	Resolved	Saisai Shao	Actions
7.	Migrate Kafka batch source to v2	Resolved	Gabor Somogyi	Actions
8.	Migrate Kafka microbatch source to v2	Resolved	Tathagata Das	Actions
9.	Migrate foreach sink	Resolved	Jose Torres	Actions
10.	Migrate unit test sources	Resolved	Unassigned	Actions
11.	Migrate unit test sinks	Resolved	Unassigned	Actions
12.	Migrate kafka sink	Resolved	Unassigned	Actions
13.	Unify continuous and microbatch V2 sinks	Resolved	Jose Torres	Actions
14.	design doc for write side	Resolved	Unassigned	Actions
15.	design doc for read side	Resolved	Unassigned	Actions
16.	clean up StreamWriter factory lifecycle	Resolved	Unassigned	Actions
17.	add epoch ID to data writer factory	Resolved	Jose Torres	Actions
18.	make StreamWriter not a DataSourceWriter subclass	Resolved	Unassigned	Actions
19.	Continuous rate source uses different offset format	Resolved	Unassigned	Actions

Comment

Migrate structured streaming sources to new DataSourceV2 APIs