Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Beam Nexmark query 7 has hotkey fanout. When Nemo translates Query7 DAG, it does not shuffle (key partitioning) in hotkey fanout.
See the attached file:
edge14 and 15 should be shuffle, but it is one-to-one. We should fix the PipelineTranslator.
+
Query4 has the similar pattern with Query7.
Nemo should shuffle data before FlattenTransform (vertex14).
