[MADLIB-1343] DL: Improve performance for predict

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: v1.16
• Component/s: Deep Learning
• Assignee: Unassigned
• Reporter: Ekta Khanna
• Created: 17/May/19 17:32
• Updated: 06/Jun/19 00:37
• Resolved: 06/Jun/19 00:37

Description

Below are the runtimes for predict on 10K MNIST examples on a simple network

model_simple = Sequential()
model_simple.add(Dense(100, activation='relu', input_shape=(784,)))
model_simple.add(Dense(10, activation='softmax'))

This ran >2 hours for 1 host / 2 segment machine Centos7 machine. That seems unreasonably long.