[PIG-2984] MergeJoin, MergeSparseJoin, and Order e2e test fail

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Fix Version/s: 0.11
• Labels: test

Environment

CentOS 6.2, Hadoop 1.0.x

• Assignee: Unassigned
• Reporter: Cheolsoo Park
• Created: 16/Oct/12 09:11
• Updated: 25/Oct/12 00:22
• Resolved: 25/Oct/12 00:22

Description

MergeJoin/MergeSparseJoin e2e tests fail with the following error:

org.apache.pig.backend.executionengine.ExecException: ERROR 2997: Unable to recreate exception from backed error: org.apache.pig.backend.executionengine.ExecException: ERROR 1102: Data is not sorted on left side. Last two keys encountered were:
zach zipper
rachel allen
        at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POMergeJoin.getNext(POMergeJoin.java:400)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.runPipeline(PigGenericMapBase.java:283)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:278)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapBase.map(PigGenericMapBase.java:64)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:266)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.secur
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getErrorMessages(Launcher.java:217)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getStats(Launcher.java:149)
        at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:400)
        at org.apache.pig.PigServer.launchPlan(PigServer.java:1264)
        at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1249)
        at org.apache.pig.PigServer.execute(PigServer.java:1239)
        at org.apache.pig.PigServer.executeBatch(PigServer.java:333)
        at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:136)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:197)
        at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:169)
        at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
        at org.apache.pig.Main.run(Main.java:604)
        at org.apache.pig.Main.main(Main.java:154)

Order e2e tests also fail because the results do not match with expected outputs.

It seems that ORDER BY is broken and causing these failures.

Issue Links

• duplicates: PIG-2975 TestTypedMap.testOrderBy failing with incorrect result
• duplicates: PIG-2999 Regression after PIG-2975: BinInterSedesTupleRawComparator secondary sort failing