Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
Currently MaxResultSize has not set in the case MlContext call being made. In case user does not specify it through spark.driver.maxResultSize, it gets set to default size (1g). In order to get unlimited data to driver we have set this size to unlimited in other calls like DML script calls through spark-submit. We need to do similar for MlContext based call.