Details
-
Sub-task
-
Status: In Progress
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
Various JMLC applications (for low-latency scoring) would also benefit from code generation. However, by default, JMLC disables dynamic recompilation in order to avoid unnecessary compilation overhead. Since both candidate exploration and candidate selection rely on sizes for validity constraints and cost comparisons, the unknowns during initial compilation can lead to invalid plans (e.g., selecting a vector side input as main input).
This task aims to introduce a new candidate exploration mode that only considers safe candidates such as unary operations, or binary matrix-scalars operations, which do not depend on size information.
Attachments
Issue Links
- links to
