[HIVE-26660] TPC-DS query 71 returns wrong results

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Unassigned
• Reporter: Sungwoo Park
• Created: 22/Oct/22 14:46
• Updated: 23/Nov/23 12:33
• Resolved: 23/Nov/23 12:33

Description

TPC-DS query 71 returns wrong results when tested with 100GB dataset. The query fails with an error:

 

Caused by: org.apache.hadoop.hive.common.NoDynamicValuesException: Value does not exist in registry: RS_39_item_i_item_sk_min
    at org.apache.hadoop.hive.ql.exec.tez.DynamicValueRegistryTez.getValue(DynamicValueRegistryTez.java:77)
    at org.apache.hadoop.hive.ql.plan.DynamicValue.getValue(DynamicValue.java:128)
    at org.apache.hadoop.hive.ql.exec.vector.expressions.gen.FilterLongColumnBetweenDynamicValue.evaluate(FilterLongColumnBetweenDynamicValue.java:88)
    at org.apache.hadoop.hive.ql.exec.vector.expressions.FilterExprAndExpr.evaluate(FilterExprAndExpr.java:42)
    at org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator.process(VectorFilterOperator.java:125)
    at org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:919)
    at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:171)
    at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.deliverVectorizedRowBatch(VectorMapOperator.java:809)
    at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:842)

 

 

Issue Links

• is caused by: HIVE-25044 Parallel edge fixer may not be able to process semijoin edges
• is fixed by: HIVE-27006 ParallelEdgeFixer inserts misconfigured operator and does not connect it in Tez DAG