Details
-
Sub-task
-
Status: Closed
-
Major
-
Resolution: Resolved
-
None
-
None
-
None
Description
This task aims to write a dml script consisting the paramserv function. We could easily reuse the MNIST LeNet example and adapt it by creating a struct-like model and passing the update function as well as the aggregation function. In this case, the update function which will be executed in workers should consist of calculating the gradients by walking the batch forward and backward steps. And the aggregation function which will be runned in parameter server should consist of updating the weights and biases by aggregating the received gradients.