Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
-
None
Description
When a vertex changes its parallelism, consumer vertices may need to respond to it. 1-1 consumer vertices would need to change their parallelism to match. Scatter-gather consumers dont need to change.
Currently, the tez dag code has special cased this for 1-1 edge which is fine for now but does not work with custom edges.
Attachments
Issue Links
- relates to
-
TEZ-2020 For 1-1 edge vertex configured event may be sent incorrectly
- Closed