[MADLIB-1405] DL: fit and fit multiple fail with memory exception in gpdb6

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: v1.17
• Component/s: Deep Learning
• Assignee: Ekta Khanna
• Reporter: Nikhil Kak
• Created: 21/Jan/20 19:00
• Updated: 01/Apr/20 18:41
• Resolved: 01/Apr/20 18:41

Description

Both fit and fit multiple fail with the following error when run with gpdb6 and a big enough dataset such as places

ERROR:  spiexceptions.InternalError: invalid memory alloc request size 1189758503 (plpy_elog.c:121)
CONTEXT:  Traceback (most recent call last):
  PL/Python function "madlib_keras_fit", line 21, in <module>
    madlib_keras.fit(**globals())
  PL/Python function "madlib_keras_fit", line 42, in wrapper
  PL/Python function "madlib_keras_fit", line 182, in fit
PL/Python function "madlib_keras_fit"