[PIG-4421] implement visitSkewedJoin in SparkCompiler

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: spark-branch
• Component/s: spark
• Assignee: liyunzhang
• Reporter: liyunzhang
• Created: 15/Feb/15 08:00
• Updated: 21/Jun/17 09:18
• Resolved: 07/May/15 20:39

Description

If visitSkewedJoin is not implemented, following unittests will fail.
org.apache.pig.test.TestSkewedJoin.testSkewedJoinWithGroup
org.apache.pig.test.TestSkewedJoin.testSkewedJoinMapKey
org.apache.pig.test.TestSkewedJoin.testSkewedJoinManyReducers
org.apache.pig.test.TestSkewedJoin.testNonExistingInputPathInSkewJoin
org.apache.pig.test.TestSkewedJoin.testSkewedJoinOneValue
org.apache.pig.test.TestSkewedJoin.testSkewedJoinWithNoProperties
org.apache.pig.test.TestSkewedJoin.testSkewedJoinEmptyInput
org.apache.pig.test.TestSkewedJoin.testSkewedJoinNullKeys
org.apache.pig.test.TestSkewedJoin.testSkewedJoinOuter
org.apache.pig.test.TestSkewedJoin.testRecursiveFileListing
org.apache.pig.test.TestSkewedJoin.testSkewedJoinReducers
org.apache.pig.test.TestJoinSmoke.testSkewedJoinWithGroup
org.apache.pig.test.TestJoinSmoke.testSkewedJoinOuter

Issue Links

• links to: review board