Details
-
New Feature
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
The downpour training framework is discussed in Google Brain.
Multiple worker groups compute gradients of parameters asynchronously. A single server group which many have multiple workers conduct update for parameters. The servers and workers may resident in the same process or different processes depending on cluster configuration parameter(i.e., worker_server_separate).