[HIVE-17412] Add "-- SORT_QUERY_RESULTS" for spark_vectorized_dynamic_partition_pruning.q

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Assignee: liyunzhang
• Reporter: liyunzhang
• Created: 30/Aug/17 04:59
• Updated: 22/May/18 23:13
• Resolved: 31/Aug/17 08:46

Description

for query

 set hive.optimize.ppd=true;
set hive.ppd.remove.duplicatefilters=true;
set hive.spark.dynamic.partition.pruning=true;
set hive.optimize.metadataonly=false;
set hive.optimize.index.filter=true;
set hive.vectorized.execution.enabled=true;
set hive.strict.checks.cartesian.product=false;
select distinct ds from srcpart;

the result is

2008-04-09
2008-04-08

the result of groupby in spark is not in order. Sometimes it returns

2008-04-08
2008-04-09

Sometimes it returns

2008-04-09
2008-04-08

Issue Links

• relates to: HIVE-16923 Hive-on-Spark DPP Improvements