[MADLIB-994] RF - improve docs for describing memory usage

• Type: Documentation
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: v1.9.1
• Component/s: Module: Random Forest
• Assignee: Unassigned
• Reporter: Frank McQuillan
• Created: 26/Apr/16 17:15
• Updated: 27/Aug/16 00:25
• Resolved: 27/Aug/16 00:17

Description

Some users are hitting VMEM limits, so docs need to give more guidance on what params affect memory.

e.g.,
Not that many rows, but a large number of features (500 - 800).

ERROR: plpy.SPIError: Out of memory (seg46 slice4 awsaiuirl1179:40006 pid=449659) (plpython.c:4648)
DETAIL: VM Protect failed to allocate 1028374648 bytes, 690 MB available
CONTEXT: Traceback (most recent call last):
PL/Python function "forest_train", line 39, in <module>
sample_ratio
PL/Python function "forest_train", line 565, in forest_train
PL/Python function "forest_train", line 2248, in _tree_train_grps_using_bins
PL/Python function "forest_train", line 1324, in _one_step_for_grps
PL/Python function "forest_train"

• • • • • • • • • • Error **********

ERROR: plpy.SPIError: Out of memory (seg46 slice4 awsaiuirl1179:40006 pid=449659) (plpython.c:4648)
SQL state: XX000
Detail: VM Protect failed to allocate 1028374648 bytes, 690 MB available
Context: Traceback (most recent call last):
PL/Python function "forest_train", line 39, in <module>
sample_ratio
PL/Python function "forest_train", line 565, in forest_train
PL/Python function "forest_train", line 2248, in _tree_train_grps_using_bins
PL/Python function "forest_train", line 1324, in _one_step_for_grps
PL/Python function "forest_train"