[HIVE-8242] Investigate test failures when hive.multigroupby.singlereducer and hive.optimize.multigroupby.common.distincts are set to false [Spark Branch]

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Spark
• Assignee: Unassigned
• Reporter: Chao Sun
• Created: 24/Sep/14 00:22
• Updated: 24/Sep/14 17:39

Description

Currently, we rely on setting hive.optimize.multigroupby.common.distincts and hive.multigroupby.singlereducer to false to enable some groupby related tests. However, some other tests may fail because of this change. For instance, in groupby10.q, the last test will fail with exception:

FAILED: SemanticException [Error 10022]: DISTINCT on different columns not supported with skew in data

Since when hive.groupby.skewindata is set to true and hive.optimize.multigroupby.common.distincts is set to false, the distinct keyword is not supported.

There may be other issues like this. This JIRA is created to collect these issues, and ideally, find out why they fail.

Issue Links

• Is contained by: HIVE-7292 Hive on Spark
• is related to: HIVE-8233 multi-table insertion doesn't work with ForwardOperator [Spark Branch]