[MADLIB-413] Neural Networks - MLP - Phase 1

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: v1.12
• Component/s: Module: Neural Networks
• Assignee: Cooper Sloan
• Reporter: Caleb Welton
• Created: 03/Mar/12 04:12
• Updated: 18/Aug/17 21:47
• Resolved: 14/Aug/17 18:48

Description

Multilayer perceptron with backpropagation

Modules:

• mlp_classification
• mlp_regression

Interface

source_table VARCHAR
output_table VARCHAR
independent_varname VARCHAR -- Column name for input features, should be a Real Valued array
dependent_varname VARCHAR, -- Column name for target values, should be Real Valued array of size 1 or greater
hidden_layer_sizes INTEGER[], -- Number of units per hidden layer (can be empty or null, in which case, no hidden layers)
optimizer_params VARCHAR, -- Specified below
weights VARCHAR, -- Column name for weights. Weights the loss for each input vector. Column should contain positive real value
activation_function VARCHAR, -- One of 'sigmoid' (default), 'tanh', 'relu', or any prefix (eg. 't', 's')
grouping_cols
)

where

optimizer_params: -- eg "step_size=0.5, n_tries=5"
{
step_size DOUBLE PRECISION, -- Learning rate
n_iterations INTEGER, -- Number of iterations per try
n_tries INTEGER, -- Total number of training cycles, with random initializations to avoid local minima.
tolerance DOUBLE PRECISION, -- Maximum distance between weights before training stops (or until it reaches n_iterations)
}

Issue Links

• links to: GitHub Pull Request #149
• links to: GitHub Pull Request #167