[SPARK-2160] error of Decision tree algorithm in Spark MLlib

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.0.0
• Fix Version/s: 1.1.0
• Component/s: MLlib
• Labels: patch
• Assignee: Unassigned
• Reporter: caoli
• Created: 17/Jun/14 00:54
• Updated: 08/Jul/14 20:26
• Resolved: 08/Jul/14 20:26

Description

the error of comput rightNodeAgg about Decision tree algorithm in Spark MLlib , in the function extractLeftRightNodeAggregates() ,when compute rightNodeAgg used bindata index is error. in the DecisionTree.scala file about Line980:

rightNodeAgg(featureIndex)(2 * (numBins - 2 - splitIndex)) =
binData(shift + (2 * (numBins - 2 - splitIndex))) +
rightNodeAgg(featureIndex)(2 * (numBins - 1 - splitIndex))

the binData(shift + (2 * (numBins - 2 - splitIndex))) index compute is error, so the result of rightNodeAgg include repeated data about "bins"

Issue Links

• duplicates: SPARK-2152 the error of comput rightNodeAgg about Decision tree algorithm in Spark MLlib