Details
-
Sub-task
-
Status: Closed
-
Blocker
-
Resolution: Done
-
None
Description
This task aims to verify FLIP-283 Use adaptive batch scheduler as default scheduler for batch jobs.
The documentation of adaptive batch scheduler can be found here .
Things to verify:
1. Verify the adaptive batch scheduler is the default scheduler of batch jobs. By default, Flink will automatically decide parallelism for operators of batch jobs if the scheduler is not specified.
2. Verify the configuration options(execution.batch.adaptive.auto-parallelism.xxx) take effect. Besides, it is also necessary to verify that the default parallelism set via parallelism.default or StreamExecutionEnvironment#setParallelism() will be used as upper bound of allowed parallelism if the execution.batch.adaptive.auto-parallelism.max-parallelism is not configured.
3. Verify the final data produced are correct.