Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Invalid
-
None
-
None
-
None
-
None
Description
Auto grouping can help reduce #tasks in cartesian product but may still result in too many tasks in case of huge input data. It will be useful for user to cap #task, so that cartesian product won't abuse available resource. The primary limiter will still be auto grouping, but this will be a hard limit which cannot be exceeded anyway.
Attachments
Attachments
Issue Links
- depends upon
-
TEZ-3458 Auto grouping for cartesian product edge(unpartitioned case)
- Closed