Details
-
Sub-task
-
Status: Closed
-
Major
-
Resolution: Duplicate
-
None
-
None
-
None
Description
A single task may be writing multiple files at the same time. If the parallelism is too high, it may lead to a large number of small files. If the parallelism is too small, the performance is not enough. This requires that the user can specify parallelism.
- Default is the same as upstream transformation
- Users can specify parallelism too.
‘connector.sink.parallelism’ = ... |
Attachments
Issue Links
- is duplicated by
-
FLINK-19945 Support sink parallelism configuration to FileSystem connector
- Closed
- is related to
-
FLINK-18508 Dynamic source supports statistics and parallelism report
- In Progress