[SYSTEMDS-1882] Perftest: Kmeans shows different behavior compared to previous releases

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Not A Problem
• Fix Version/s: SystemML 0.15
• Assignee: Matthias Boehm
• Reporter: Matthias Boehm
• Created: 02/Sep/17 06:33
• Updated: 09/Sep/17 00:50
• Resolved: 02/Sep/17 23:32

Description

The current SystemML master shows different convergence behavior on the perftest Kmeans scenarios. Triggered by significantly increased execution times, a comparison with 0.14 showed the following output (note the different number of iterations):

With SystemML 0.14

Run 1, Iteration 1:  Terminated with code = 3,  Centroid WCSS = 1.1884874830960146E11
Run 3, Iteration 2:  Terminated with code = 1,  Centroid WCSS = 1.1836165397662901E11
Run 2, Iteration 2:  Terminated with code = 1,  Centroid WCSS = 1.1836165397662901E11
Run 7, Iteration 2:  Terminated with code = 1,  Centroid WCSS = 1.1836165397662901E11
Run 6, Iteration 2:  Terminated with code = 1,  Centroid WCSS = 1.1836165397662901E11
Run 9, Iteration 2:  Terminated with code = 1,  Centroid WCSS = 1.1836165397662901E11
Run 8, Iteration 2:  Terminated with code = 1,  Centroid WCSS = 1.1836165397662901E11
Run 4, Iteration 2:  Terminated with code = 1,  Centroid WCSS = 1.1836165397662901E11
Run 5, Iteration 2:  Terminated with code = 1,  Centroid WCSS = 1.1836165397662901E11
Run 10, Iteration 2:  Terminated with code = 1,  Centroid WCSS = 1.1836165397662901E11

With SystemML master:

Run 8, Iteration 12:  Terminated with code = 1,  Centroid WCSS = 1.0897515693466766E11
Run 4, Iteration 14:  Terminated with code = 1,  Centroid WCSS = 1.0900183622869571E11
Run 1, Iteration 15:  Terminated with code = 1,  Centroid WCSS = 1.0892913262046584E11
Run 2, Iteration 16:  Terminated with code = 1,  Centroid WCSS = 1.0893145533814377E11
Run 6, Iteration 17:  Terminated with code = 1,  Centroid WCSS = 1.0881596327984634E11
Run 3, Iteration 17:  Terminated with code = 1,  Centroid WCSS = 1.0910103829718127E11
Run 7, Iteration 20:  Terminated with code = 1,  Centroid WCSS = 1.089467832141638E11
Run 10, Iteration 20:  Terminated with code = 2,  Centroid WCSS = 1.0873719552339151E11
Run 5, Iteration 20:  Terminated with code = 2,  Centroid WCSS = 1.0891758743999176E11
Run 9, Iteration 20:  Terminated with code = 2,  Centroid WCSS = 1.089222095610236E11