[MADLIB-1394] DL: Predict changes for asymmetric cluster config

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: v1.17
• Assignee: Unassigned
• Reporter: Ekta Khanna
• Created: 12/Nov/19 00:16
• Updated: 18/Dec/19 23:33
• Resolved: 18/Dec/19 23:33

Description

Predict
For predict we only support symmetric clusters, either all CPU or with GPUs on all hosts.

madlib_keras_predict(
    model_table,
    test_table,
    id_col,
    independent_varname,
    output_table,
    pred_type,
    use_gpus  -- changed definition
    )

{use_gpus}

(optional)
BOOLEAN, default: FALSE (i.e., CPU). Determines whether GPUs are to be used for prediction/inference. Set to TRUE to use GPUs.

Note
The prediction function uses the whole cluster. So if you are using GPUs, it requires that GPUs are attached to all hosts. This is different from the fit() and evaluate() functions that support GPUs on only some of the hosts (asymmetric cluster). Therefore, if you have GPUs only on some of the hosts, set this parameter to FALSE to use CPUs.

Predict BYOM
Same as predict above ^^^.