[HIVE-9112] Query may generate different results depending on the number of reducers

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.14.0
• Fix Version/s: 1.0.0
• Component/s: Logical Optimizer
• Assignee: Ted Xu
• Reporter: Chao Sun
• Created: 15/Dec/14 23:00
• Updated: 19/Feb/15 18:22
• Resolved: 16/Jan/15 16:46

Description

Some queries may generate different results depending on the number of reducers, for example, tests like ppd_multi_insert.q, join_nullsafe.q, subquery_in.q, etc.

Take subquery_in.q as example, if we add

set mapred.reduce.tasks=3;

to this test file, the result will be different (and wrong):

@@ -903,5 +903,3 @@ where li.l_linenumber = 1 and
 POSTHOOK: type: QUERY
 POSTHOOK: Input: default@lineitem
 #### A masked pattern was here ####
-108570 8571
-4297   1798

Issue Links

• blocks: HIVE-9026 Re-enable remaining tests after HIVE-8970 [Spark Branch]
• links to: RB Link