[SYSTEMDS-2403] Paramserv low accuracy sometimes occurred

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: SystemML 1.2
• Epic Link: Language and runtime for parameter servers
• Assignee: LI Guobao
• Reporter: LI Guobao
• Created: 16/Jun/18 12:35
• Updated: 13/Jul/18 22:16
• Resolved: 13/Jul/18 22:16

Description

We could observe that the low accuracy will sometimes occurred. Here is the scenario: BSP, BATCH, DISJOINT_CONTIGUOUS (or DISJOINT_RANDOM) with 1 epoch, 4 workers (I have 4 vcores in my machine) and batchSize 16 using 60k minist.

Val Loss:	2.3006845853187783
Val Accuracy:	0.11183333333333334