Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8242

Investigate test failures when hive.multigroupby.singlereducer and hive.optimize.multigroupby.common.distincts are set to false [Spark Branch]

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Spark
    • Labels:
      None

      Description

      Currently, we rely on setting hive.optimize.multigroupby.common.distincts and hive.multigroupby.singlereducer to false to enable some groupby related tests. However, some other tests may fail because of this change. For instance, in groupby10.q, the last test will fail with exception:

      FAILED: SemanticException [Error 10022]: DISTINCT on different columns not supported with skew in data
      

      Since when hive.groupby.skewindata is set to true and hive.optimize.multigroupby.common.distincts is set to false, the distinct keyword is not supported.

      There may be other issues like this. This JIRA is created to collect these issues, and ideally, find out why they fail.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                csun Chao Sun
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: