Details
-
Improvement
-
Status: Open
-
P2
-
Resolution: Unresolved
-
None
Description
Now, the JDBC IO is basically a DoFn executed with a ParDo. So, it means that parallelism is "limited" and executed on one executor. ReadWithPartitions does some preliminary partitioning of the data, but any skew in data range or workload will create an unbalanced workload.
Attachments
Issue Links
- links to