[SPARK-8023] Random Number Generation inconsistent in projections in DataFrame

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.4.0
• Component/s: SQL
• Target Version/s: 1.4.0
• Assignee: Yin Huai
• Reporter: Burak Yavuz
• Created: 02/Jun/15 00:05
• Updated: 02/Jun/15 07:22
• Resolved: 02/Jun/15 07:22

Description

to reproduce (in python):

df = sqlContext.range(0, 10).withColumn('uniform', rand(seed=10))
df.select('uniform', 'uniform' + 1)

You should see that the first column + 1 doesn't equal the second column.

Issue Links

• links to: [Github] Pull Request #6570 (yhuai)
• links to: [Github] Pull Request #6573 (rxin)